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Development of Survey Instruments for the Study of Educational 
Research, Development, Diffusion and Evaluation Training Requirements 

THE PROBLEM 



Information concerning the job functions and training of personnel 
engaged in educational Research, Development, Diffusion and Evaluation 
activities (R-D-D-E) is needed by the Research Training Branch (RTB), 
Division of Research and Development Resources, National Center For 
Educational Research and Development (NCERD) in order to assist in the 
development of programs responding to requirements for trained personnel 
in those activity areas. Certain of the questions relating to types of 
employment, numbers employed, experience and educational backgrounds of 
current employees, training needs and areas of current and future employment 
can best be answered through data from a national survey of employers of 
R-D-D-E personnel and of the personnel themselves. Stanford Research 
Institute has been given the responsibility for developing and pretesting 
the required survey instruments. 

There are a number of RTB tasks to which the survey information will 



contribute. The first of these is the determination of the number. 



distribution by type, and location of educational R-D-D-E personnel. A 
number of previous studies have provided some of the information needed 
in these areas, but the proposed survey will be conducted on a national 
probability sample basis and give a more definitive picture of the current 
situation as regards educational R-D-D-E personnel. The estimates from 
the survey can be used as a basis for projections of the need for educational 



R-D-D-E personnel as that need relates to increasing R-D-D-E budgets. 

A second major focus of the survey will be training requirements, 
since RTB must develop plans and programs and specify funding for consortia 
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or other training arrangements . Survey items relating to disciplines 
in which current R-D-D-E employees are trained, previous experience 
and employees' and supervisors' stated training needs will contribute 
to such planning and prog rawin' ng . A related matter is that of the 
transferability of personnel trained in behavioral or social science or 
in other disciplines into educational R-D-D-E jobs. Such personnel 
constitute a pool from which needed employees might be drawn, and it 
will be useful to know what kinds of skills they may have, and types 
of previous employment and training needs as perceived by themselves 
and their supervisors. Such information will provide one basis for 
planning retraining or updating programs. 

Planning training program content requires knowledge of the skills 
needed in various kinds of R-D-D-E jobs, and the survey will provide such 
information as well. 

Recruiting and selection information will also be provided by the 
survey. 
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QUESTIONS ORIGINALLY POSED BY THE RESEARCH TRAINING BRANCH 
The following questions were posed originally by RTB for possible 
inclusion in the survey: 

• How many people are presently (at the time of the survey) 
employed in educational R-D-D-E activities in the United States? 

• In what types of activities are they employed? 

• How many are employed at each of several professionals levels? 

• What are the average annual salaries Ly levels? 

• What proportions are full time and part time employees? 

• How are educational R-D-D-E employees distributed with respect 
to ethnic groups, sex and geography? 

• In what types of institutions are educational R-D-D-E 
personnel employed? 

• What kinds of job preparation have they had, including 
formal preservice education, inservice education and training 
and on the job training and experience? 

• What is the average length of service in the same job activity, 
at the same level and in the same institution? 

• What value level do employees assign to their work as compared 
to other jobs for which they might be qualified? 

• What possibilities for advancement do they see in their work? 

• What proportion view themselves as skilled in other areas of 
oducatl on? 

• How many additional persons will be employed in educational 
R-D-D-E in three years from the period of the survey? 

• How much additional employment will result from turnover rather 
than growth as personnel leave educational R-D-D-E or are promoted. 
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• In a non-growth situation, how will changes in R-D-D-E activities 
be reflected in demands for differing job skills? 

• If needed skills remain stable, how much additional employment 
will result from increased funding of educational R-D-D-E? 

• How will fluctuation in educational priorities and funding 
be reflected in differing demands for job skills? 

• What are the preferences for training by type, i.e., preemployment, 
formal postemployment, or on-the-job, and what is the willingness 
of employers to pay for needed employee training? 

• What kinds of recruitment and selection procedures and criteria 
are used? 

• What importance do employers place on degrees as employment 
requi remen ts? 

• What skills and skill groupings are needed in educational R-D-D-E? 

• At what level do employers rate quality of skills in their 
empl oyees? 

• How satisfied are employees with their R-D-D-E jobs? 

The questions were many and diverse, and the task was to fit them into 
instruments of usable length and minimal complexity so as to obtain a 
satisfactory rate of return. 
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DEVELOPMENT OF THE QUESTIONNAIRES 

Two basic types of instruments were required, one to be filled out 
by employers or supervisors and one by employees. A substantial body 
of background information was examined prior to designing the questionnaires 
and writing the items. In particular, the listing of R-D-D-E skills 
prepared by the American Educational Research Association (AERA) Task Force 
on Training of Educational Research Personnel was found to be comprehensive 
and very useful. The pretest questionnaires used most of these items 
substantially as they were originally written. All of the items are given 
in Appendix A, Another source that provided item formats for the final 
version of the questionnaires was The General Position Activities 
Questionnaire prepared by Teaching Research, a division of the Oregon State 
System of Education, 

Ultimately, two versions of the employer questionnaire, designed 
to be used by two different types of employers, and four versions of the 
employee questionnaire were produced and pretested. The necessity for 
four versions of the employee Instrument was based on our desire to use 
most of the 94 comprehensive skill items on the AERA list, but to reduce 
the response burden on any one individual , in accordance with the general 
guideline for all questionnaires that they require minimum respondent time 
consistent with the valid and reliable acquisition of the necessary survey 

?ri' 

1 nformati on , 

Questionnaires were designed for use in a two-stage survey with employer 
questionnaires mailed first, followed by the employee questionnaires sent 
to a sample of employees selected on information provided by employers on 
their questionnaires. 

Format and content of both types of questionnaires were heavily 
influenced by the information obtained in a series of interviews conducted 
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with local education agency personnel and with supervisors and employees 
in a variety of research and development organizations in the San Francisco 
Bay Area. These interviews included discussion of the RTB information 
needs in relation to the kinds of information that each type of agency 
could and would be willing to provide, consideration of appropriate formats 
for various kinds of questions, and general discussion of the problems 
relating to R-D-D-E employment and training. 

Employer Quest! onnai res 

Two primary types of employers of R-D-D-E personnel were fa be surveyed. 
The first of these were leaders of educational R-D-D-E projects funded by 
the U. S. Office of Education, the Office of Economic Opportunity, or the 
National Science Foundation. The second were leaders of R-D-D-E units in 
school districts. Additional smaller but not less important groups of 
respondents included leaders of projects or units situated in governmental 

bodies at Federal, State or County levels and personnel in Federally 

JE- 

funded research and development laboratories and centers. It was hoped 
that questionnaires prepared for the first two categories would also be 
appropriate for these latter groups with minimal modification. 

The previously listed questions posed by RTB formed the basis for 
development of the following areas that were covered in the employer 
questionnai re: 

• Identification of respondents, their institutions and projects 

or work units (identification information asked for in questionnaires 
sent to project leaders differed in some respects from that to be 
obtained from local education agency work units) 

• Identification by percentage of time spent on each of the kinds 
of work performed by the units or project personnel 
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• Identification of skills and content area knowledge difficult 
to find in recruiting and selecting personnel 

• Recruiting procedures and methods used with estimates of their 
effectiveness 

• Selection techniques used with estimates of their effectiveness 

• Numbers of employees and full time equivalents in each of seven 
personnel categories including director or principal investigator, 
research and development associate, assistant, intern, technician 
paraprofessi onal and clerical, with estimates of education and 
experience required for successful performance in each category 
and listing of formal organizational requirements for each 
category 

© Estimates of adequacy of previous training of current employees 
in each personnel category 

• Description of kinds of in-house employee training used with 
specification of frequency of use 

® Estimates of need for additional training in each of a variety 
of educational R-D-D-E activities (selected from the AERA list) 
and indication of areas in which training materials would be 
desl red 

• Indication of value placed on each of a variety of training 
approaches for current employees 

• Indication of number of current unfilled positions, losses in 
the last year and additions in the last year for each 
personnel category 

• Estimates of number of employees in each personnel category to 
be hired in the coming two years 
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• Estimates of need for additional employees by type and skill if 
funding were increased by 50% in the coming year 

It was anticipated that information in each of those areas drawn from 
appropri ately structured samples of project directors, local education agency 
unit directors and federal and state education personnel would provide a full 
picture of personnel shortages and training needs seen from the point of view 
of employers of educational R-D-D-E personnel 

The employer questionnaire was also to ask for a listing by name of 
current employees from which a sample of employees could be drawn by the 
survey agency. The sample members were then to be sent employee 
questi onnai res , 

The employer questionnaire was subjected to a number of revisions 
in order to reflect the conments of the persons who were interviewed and 
to reduce it in length and complexity so as to enhance the probability of 
achieving a high return rate of usable questionnaires. It was recognised 
that the number of areas to be covered might be so great as to make the 
pretest questionnaire excessively long, but we felt it necessary to use 
the pretest results as one of the primary bases for cuts, so there seemed to 
be no alternative to mailing a long version informing the respondents that 
it was a pretest and asking their cooperation in helping us to tighten up 
the instruments for ultimate use. 

Copies of the pretest mail out employer questionnaires are in Appendix B. 
Employee Questionnaires 

As indicated above employees in the projects and units to whom employer 
questionnaires were sent were also asked to respond to a questionnaire 
concerning their work activities, experience and training. It was desired 
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al so that the employee and employer questionnaire have some common items 
so as to permit cross comparisons between the two groups of respondents. 

The following areas based on the original RTB questions covered 
in the employee questionnaires: 

• Identification of respondents, their institutions and projects 
or work units, their ages, sex, salaries, and formal education 
levels 

• Indications of levels of involvement in a variety of R-D-D-E 
activities, experiential or educational source of the acquisition 
of the skills needed for each activity and estimates of the need 
for additional training in the skills needed for each activity. 

• Amount of formal course work in each of a variety of educational 
areas 

« Amount of in-house or on-the-job training obtained since employment 
in R-D-D-E fields 

• Specification of educational R-D-D-E in which respondents are 
currently active with their estimates of the degree to which 

their skills have increased in each activity during present employment 
and of the amount of additional training needed in each activity 
area. (The activity areas listed were identical with those on the 
employer forms so as to permit comparisons of the training need 
perceptions of both groups of respondents) 

• Types of previous employers, years spent with each and estimates 
of relevance of each previous type of employment to current jobs 

• Existing skills not used on current jobs 

• Job satisfaction 
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© Estimate of advancement possibilities 

• Value to respondent of various types of training or training materials 

• Importance of college credit for additional training 

There were four versions of Questionnaire B for employees. They differed 
only in respect to the lists of educational R-D-D-E items that were included 
in each. The problem was to use all of the carefully developed list of AERA 
items, but not to overburden any one respondent. Ten items were common to 
all lists. The remaining 84 items were divided equally (21 each) among the 
four versions so that each individual would respond to a total of 31, The 
wording of some items was changed (usually by shortening) for our purposes. 

The ten common items were as follows: 

• Identifying and delineating significant researchable problems 

• Interpreting and drawing appropriate conclusions and implications 
from data analyses 

• Specifying desired performance outcomes (objectives) of instruction 

• Describing a product to be developed 

• Selecting the most effective dissemination vehicles to convey 
information to target groups 

• Implementing actual dissemination, including the direction of 
technical production personnel 

• Identifying and rating alternative strategies for attaining 
the selected educational system objectives 

• Identifying and rating available educational program resources 
(human, material and financial) and/or potential sources of 
support 



±z 

o 

me 



-n- 



© Developing general criteria and designing data collection 
procedures for application in measuring the effectiveness and 
efficiency of existing innovative practices and products, 

• Selecting (or developing) and using techniques of measurement 
to yield information relevant to standards to be used 
The set of ten items listed were chosen as the common ones because 
they include some from each of the R-D-D-E categories and because the 
items listed were among those receiving the highest number of mentions 
as most important or critical in the AERA survey and regarded as significant 
for the proposed survey. 

Information from employee questionnaires was expected to supplement 
and complement that from employer questionnaires so as to provide a 
comprehensive picture of educational R-D-D-E personnel characteristics, 
experience and training backgrounds and training needs. 

The mailout employee questionnaires are in Appendix B. 
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DESCRIPTION AND CONDUCT OF THE FIELD TEST 

The field test was designed to duplicate as much as possible under 
the necessary time constraints, the conditions that would obtain in the 
main survey effort itself. Respondents were informed, however, that the 
questionnaires were being pretested, and they were asked to comment on 
any and all aspects of content of format and to suggest any changes 
that they felt might be appropriate. Both the response rate and the 
response time may have been affected by the request to comment on the 
questionnaire, but it was felt necessary to do so in order to pretest 
thoroughly. 

The mail pretest had been preceded by a substantial number of inter- 
views with project and Local Education Agency (LEA) unit directors and 
their subordinates and with questionnaire specialists in which earlier 
versions of the questionnaires were gone over in detail to obtain comments 
and criticisms. Interviewees were asked to indicate the appropriateness 
of each of the items as it related to t'neir activities, whether or not 
they could answer each unequivocally, and their detection of ambiguities 
or redundancies. The interview results were used to make further revisions 
in the questionnaires and procedures prior to the pretest mailout. 

A special interview pretest involving Federal Government personnel 
was also carried out. About one dozen interviews were conducted. Respondents 
were asked to fill out the questionnaires while the SRI interviewer was 
present, and to comment on each item as they felt appropriate. Most of the 
respondents were from the Office of Education but the National Science 
Foundation and the Office of Economic Opportunity were represented as well. 
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Sample for the Mail Pretest 

The mail questionnaire pretest was conducted primarily in the 
San Francisco Bay Area with some additional mail out to Southern California, 
Nevada, and Oregon. It was felt that a sample chosen from these areas 
would be sufficiently representative for pretest purposes, that the response 
time might be reduced by the shorter distances and that it would be easier 
to conduct any necessary telephone followup if the pretest were localized. 

The mail questionnaire sample of California School Districts was 
selected according to size of the district based on student census data. 

The districts ranged in size from 1,000 to 770,000 and were further sub- 
divided into the foil '-wing intervals. 



District Si ze 

50.000 or more 

25.000 to 49,999 

12.000 to 24,999 
Less than 12,000 



Number of Districts Sampled 
9 

12 

17 

26 



Total sample 64 



The second population sampled consisted of universities and organizations 
with current on-going projects related to educational R-D-D-E. These projects 



were categorized by dollar amount of the contract or grant with a range from 
$5,000 to over $200,000 and divided into the following intervals. 



Project Dollar Amount 


Number of Projects Sampled 


200,000 or more 


11 


100,000 to 199,999 


10 


50,000 to 99,999 


11 


Less than 50,000 


9 




Total sample 41 
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Another group to whom questionnaires were sent were Federally 
sponsored Research and Development Laboratories and Centers. These 
organizations are major employers of R-D-D-E personnel, and it was 
essential that they be included. 

Questionnaires were also sent to the State Departments of 
Education in California, Nevada, and Oregon. 



For the purposes of the pre-test, only two of the four employee 
forms were used. The overall scheme for the mailing was as follows: 



School 
Di stri ct 


Package with Questionnaire A 
and 4 Questionnaire B 


Questionnaire A only to 
return list of names 


Total 

sent 


Form Bl 


Form B2 


Form Bl 


Form B2 




22 


20 


12 


10 


64 


Project 
or Unit 
Di rector 


15 


12 


8 


6 


41 


Total 


37 


32 


20 


16 


105 



Description of the Questionnaire Mailing 

Two general methods were employed in mailing the questionnaires to both 
project directors and school districts. The first of these involved enclosing 
four "employee" forms (Questionnaire B) with the "employer" form (Questionnaire 
A) with the request that the Individual receiving the package route them to 



the appropriate respondents. The second method included a page in 
Questionnaire A on which the respondent could write in the names of a 
sample of individuals working on the project who would be potential respondents 
on Questionnaire B. A procedure for choosing the names from a roster of 
project or unit staff was included also. The intent of this dual procedure 



to try out both methods for possible future use in the final survey. 
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The ultimate choice of method was to be based on the kinds of responses 
received from the two approaches, on which method would produce the most 
satisfactory sample of employees and on any time limitations that might 
exist, since two separate mailings may be expected to take longer in 
view of the need to get fairly complete returns from the first mailing 
before structuring the sample and sending out the second mailing. The 
latter procedure has an advantage, however, in that it permits the 
survey contractor to choose the sample from a complete roster rather 
than having its choice based on local sampling that might not always 
be carried out strictly in accordance with the instructions given. 

Questi onnai re Returns 

All Questionnaires were mailed on or before November 20, 1971 with 
the first returns being received approximately four days later. Between 
the time of the initial return and December 3, 1971 (the first two week 
period) there were 30 returns from school districts and 8 from project 
or unit directors. During the following three week period the returns 
were 9 and 6 respectively. Although these figures represent both complete 
and incomplete forms, they do indicate that the majority of responses 
will be received within two or three weeks of the initial mailing date. 

This is consistent with SRI experience in previous surveys. 

Of the returns received during the first two weeks there were three 
completed by Project Leaders and three completed by School Districts. Three 
incomplete returns were received from Project Leaders and 23 from School 
Districts. It should be noted that most of the incomplete returns from 
School Districts resulted from the fact that they did not employ at least 
one full time person or full-time equivalent in R-D-D-E as they understood 
the descriptions of these activities. We established the criterion of one 
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full time employee or equivalent as determined whether or not the form 
should be filled out, A few incompletes were from districts that 
routinely refuse to fill out questionnaires, of which there are an increasing 
number, A probable additional factor in accounting for low return rates 
in recognition that there have been previous and fairly recent surveys 
in this field and an inability to understand why it is necessary to conduct 
another survey. Some projects involve only one or two people, and it 
may have been difficult for them to see how the personnel survey was 
relevant to their activities, especially if employees are graduate students 
or other faculty members. A few commented to that effect. Some directors 
of larger projects could not see the relevance of the survey to their 
concerns, felt that their organization, staffing and funding were not 
appropriate to the survey questions, that previous work with which they 
were familiar had already covered the area or simply did not want to 
take the time to fill out an instrument relating only peripherally to 
their work. 

All pretest returns were examined carefully so as to insure that no 
relevant comments were missed, but there was no attempt to tabulate the 
results in view of the awareness of the respondents that the questionnaires 
were being pretested, the limited returns in some categories, and our 
primary interest in format and wording rather than specific responses 
to the questions. 

Comments and Recommendations Received in Returns 

The mail pretest returns included a number of comments, recommendations 
and suggested changes. The following (listed roughly in order of frequency 
of mention from highest to lowest) appeared most prominently: 
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The questionnaires should be reduced in length. (The pretest 
instruments had, of course, contained more items than would 
ultimately be used, but we felt it essential to get reactions 
to all of them in order to determine which ones should be 
selected for the final questionnaires.) 

The number of R-D-D-E activity and skill items should be reduced 
on both questionnaires 

The multiple responses required for the R-D-D-E activity and 
skill items should be reduced on the employee questionnaire 
The R-D-D-E activity and skill items should be reworded, made 
more pointed and shortened on both questionnaires 
The item on the employer questionnaire having to do with 
percentages of time devoted to various kinds of activities 
should be reformatted and the response task simplified. 

The question on the employer questionnaire asking for an 
indication of need for training for employees in each of a 
number of activities should be eliminated because the 
employer could not make such judgements for all of his 
employees considered as a group 

The personnel categories on the employer questionnaire should be 
reduced in number and consolidated so as to make it clear what the 
distinctions are. Some organizations use other systems of 
categorization, and there is insufficient uniformity to permit 
unequivocal responses to the item. 
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Comments on the Questionnaires from Federal Agency Personnel 

Federal Agency respondents filled out the questionnaires while the 
SRI interviewer was present so there was an opportunity for the exchange 
of ideas. The following comments were made: 

• The questionnaires lack direct relevance to the work activities 
and positions of most Federal employees , primarily because they 
administer and monitor the R-D-D-E activities of others rather 
than conducting them. 

• Questions relating to funding and its relationship to manpower 
have a different meaning for Federal personnel, since budget 
justifications must include specific personnel requirements. 

• Questionnaires should be shortened so as to conserve respondent 
ti me. 

• There is some confusion about tenure in the present job for 
Federal employees since they often transfer within an organization. 

• The list of activities in the employee questionnaire should be 
shortened and meanings clarified. 

t On the employer questionnaire, the list of activity items in 
Question 9 was felt to represent several levels of generality, 
and some should be subsets of others. 

• The rating of percent of effort devoted to various activities 
(Question 1) was felt to be very difficult to carry out, and it 
was suggested that there was a need for specifying either man 
hours or dollars 

• The personnel categories on the employer questionnaire were not 
appropriate for federal employees and distinctions among the 
categories were not entirely clear. 
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• In general, respondents felt that a somewhat broader view of 
r_q_q-E and R-D-D-E personnel should be taken. This may have 
been due to their not having seen all of the work activity 
items, although they were informed that the list they saw was 
not meant to be comprehensive. 

Cost data for the preparation and mailing of the questionnaires is 
provided in Appendix D. 
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REVISIONS RESULTING FROM THE PRETEST 



The questionnaires were subjected to four or five revisions prior to 
the mail pretest. The early changes were based on conversations with 
questionnaire specialists at SRI and elsewhere and the reactions of school 
district and project personnel who were interviewed and asked to comment 
in detail on each of the questionnaire items. Most of the changes prior 
to the mail pretest had to do with the wording and format of the items with 
the aim of insuring that potential respondents would understand the 
instructions and the items and be able to give unambiguous responses to 
them. The areas to be covered were not changed during the preliminary 
revision phase. 

Revisions to the Employer Questionnaire 

A copy of the revised Employer Questionnaire is in Appendix C. 

The cover letters were revised so as to be appropriate for the final 
survey rather than the pretest. A draft of an additional cover letter 
to be sent from The Bureau of Elementary and Secondary Education (BESE) or 
The National Center for Educational Statistics (NCES) to school districts, 
or from the project sponsoring organization of The National Center for 
Educational Research and Development (NCERD) or NCES to Project Directors 
were also prepared for use in obtaining cooperation from potential respondents 
In the case of National Science Foundation or Office of Economic Opportunity 
sponsors the letter would come from them. 

R-D-D-E activity descriptions were made more operational. Minor changes 
in identifying information were made also. 

Each item in the mail out questionnaire will be described below, and 
any changes will be specified. 
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Pretest 

Question 

Number 

Question 1 required an estimate of percent of effort devoted to 
a variety of activities. In the revised form the 
number of activities has been reduced, and those 
remaining are more closely centered around R-D-D-E. 
Response is now in terms of the four categories of 
"large", "moderate", "small" or "no part" of the effort 
instead of percentage estimates. 

Question 2 concerning skills or sensitivities that have been 

difficult to find in recruiting is now Question 10* 
and it has been reworded slightly. 

Question 3 concerning content area knowledge that has been 

difficult to find in recruiting is now Question 11, 
and it has been reworded slightly. 

Question 4 concerning recruiting procedures used and their degrees 
of effectiveness is now Question 12. 

Question 5 concerning selection techniques used and their degrees 
of effectiveness is now Question 13. 

Question 6 concerning the number of employees in each of seven 
personnel categories and the respondents' and his 
organizations' requirements for each position is now 
Question 2. The previous categories were as follows: 
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• Director or principal investigator 

Full responsibility for a program or a large scale project 
m Research and Development Associate 

Full responsibility for medium size and smaller projects 

• Research and Development Assistant 

Responsibility under supervision for some part of a project 
such as for data collection and reduction 
9 Research and Development Intern 

Carries out assigned specific tasks under supervision 

• Technician 

Carries out assigned specific tasks requiring limited 
technical skills under supervision 

• Paraprofessi onal 

Carries out assigned specific tasks requiring little or 
no technical skill under supervision 

• Clerical 

The new categories are: 

• Professional 

Substantial responsibility for carrying out project or 
unit tasks independently 
m Paraprofesslonal 

Responsibility for carrying out project or unit tasks 
under moderate to heavy supervision, with little 
independence of action 
» Technical 

Trained for and carries out specific project activities 
such as computer programming, audio-visual aid preparation 
or art work 
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• Clerical 

Routine typing, filing, numerical and other clerical tasks 



The respondent is now asked only to provide the numbers of 
full-time and part-time employees and the number of full time 



equivalents. The requirements categories have been eliminated. 

Question 7 concerning previous training for each personnel 
category has been eliminated. 

Question 8 concerning varieties of in-house employee training used 
is now Question 7 and the request to indicate numbers 
of times used, percent of employees enrolled, time required, 
and course descriptions has been eliminated. 

Question 9 concerning R-D-D-E activities in which employees needed 
training and desired training materials has been 



eliminated. 

Question 10 concerning the value of various training approaches 
is now Question 8. 

Question 11 concerning unfilled positions, losses, and personnel 

added is now Question 4. The personnel categories have 
been changed as in Question 2 on the final form. 

Question 12 concerning anticipated hiring in the next two years is 
now Question 5. Personnel categories are as in 
Questions 2 and 4. 

Question 13 concerning hiring if additional funding were available 
is now Question 6 and the increase in funding has been 
reduced from 50 to 25 percent. 
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Question 14 asking for a listing of personnel by name is now 



Question 3, and tnere Is an additional requirement 
to specify either full time or the fraction of full 
time that was worked for each employee. 



A rationale for each of the questionnaire items has been appended 
in addition. 

The general effect of the revisions is to shorten the instrument 
and make the response task simpler and easier. 

Revisions to the Employee Questionnaire 

The revised Employee Questionnaire is in Appendix C. 

The cover letter was revised so as to be appropriate for the final 
survey rather than the pretest. Additional assurances regarding confi- 
dentiality were included. 

Minor changes in Identifying information were made. 

Each item in the mail out questionnaire will be described below, and 
any changes will be specified. 

Pretest 

Question 

Numbe r 

Question 1 was the list of 31 activity items (10 common and 



21 different on each of the four forms). Respondents 



were to indicate their degrees of involvement in each, 
the means by which they acquired the skills for each, 
and the extent of their felt need for training in each 
set of skills. This is now Item 3. There is one form. 



ERIC 



and it includes only 25 of the items from the AERA list. 
Ten items are corrmon to the original four lists. The 
remaining 15 were selected from the four lists. All have 
been reworded in much briefer form. Response requirements 
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Questi on 



Questi on 



Questi on 



Questi on 



Questi on 



Questi on 



Question 



Questi on 



0 




have also been simplified. We adopted the seven-point 
scale for degree of involvement in each activity that 
was devised by Teaching Research, a Division of the 
Oregon State System of Education on their General 
Position Activities Questionnaire. Interest in 
additional training is indicated by entering a "G" » 

"S" or "N" for "great", "small", or "no interest" in 
additional training. 

2 concerning amount of education in each of 21 different 
areas or disciplines remains as Question 2, 

3 concerning amounts of postemployment training is now 
Question 4. 

4 concerning types of previous employers, numbers of years 
with them and relevance to present jobs is now Question 1. 

5 concerning skills that the respondent has but does not 
use in his present job has been eliminated. 

6 concerning extent of job satisfaction is now Question 7 
and space for comnent on reasons for satisfaction or 
dissatisfaction has been added. 

7 concerning extent of advancement possibilities is now 
Question 8 and space for listing reasons for estimates 
of advancement probabilities had been added. 

8 concerning value placed on various types of additional 
training is now Question 5. 

9 concerning degree of importance of college credit for 
additional training is now Question 6. 
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A rationale for each of the questionnaire items has been appended 
in addition. 

The general effect of the revisions, as in the case of the employer 
form is to shorten the instrument, and make the response task simpler 
and easier. 
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RECOMMENDATIONS FOR THE CONDUCT OF THE FINAL SURVEY 

Development interviews and pretest responses suggested a number 
of changes in procedure and questionnaire content that can be expected 
to contribute substantially to the success of the final survey. 

The instruments were shortened and simplified so as to reduce the 
burden on respondents and to enhance the response rate. 

In addition, however, in the final survey, it will be necessary to 
use procedures that will help to motivate recipients to respond, call 
for minimal time and effort consistent with acquiring the necessary data, 
provide for follow-up and analysis of non-respondent characteristics, and 
include in the school district sample only those districts for which there 
is reasonable assurance that R-D-D-E capabilities as they are defined for 
survey purposes do exist. In addition, personal contacts by telephone and, 
in some cases, in person may be required to help in motivating potential 
respondents to provide the needed data. 

Specific recommendations are as follows: 

• The survey should be carried out on a two-stage basis with 
project directors and school district unit leaders receiving 
the employer questionnaire and a request for a listing of 
professional and paraprofessi onal employees. The lists should be 
used by the survey contractor to select a sample to whom the employee 
questionnaires are sent. The procedure in which the respondent 
selects the sample from among his employees in accordance with 




instructions is subject to error or carelessness of unwillingness 
on the part of some respondents to undertake it. The two stage 
procedure was not fully carried out in the pretest because of time 
constraints. At least three months from the initial mai 1 out date 
should be allowed for completion of both stages. 
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• If lists of personnel on federally funded projects can be 
obtained, the list for each project could be sent to the 
project director with the request that he correct it. This 
procedure would reduce the listing process to a minimum. 

• Each School District Employer questionnaire should be 
accompanied by a cover letter from The Bureau of Elementary 

and Secondary Education (BESE) or National Center for Educational 
Statistics ( NCES ) asking for cooperation in the survey. Each 
project employer Questionnaire should be accompanied by a cover 
letter from NCES or the appropriate Office of Education, Office 
or Economic Opportunity, or National Science Foundation 
Division head. 

• The content of the final survey questionnaires should be 
essentially as it now appears in the drafts Included in this 
report. Some alterations may be desirable as the Oregon Studies 
(Teaching Research, Monmouth, Oregon) and AERA data are subjected 
to further analysis, since those surveys have covered work 
activities quite thoroughly. 

• Before mail out, the final survey questionnaires should be put 
in booklet form, print size should be reduced, and both sides 
of each sheet used so as to reduce bulk as much as possible. 

Layout and margins should contribute to an attractive appearance, 
an uncluttered look and to ease of response. 

• Questionnaire blanks should be precoded for punching and computer 
processing in accordnace with the processing and analysis plan 

to be used. 
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• A follow-up mai lout to non-respondents should be undertaken in 
from two to three weeks after the initial mai lout. 

• An analysis of non-respondents should be undertaken in order to 
determine any differences from those who did respond. 

• Mail questionnaire data should be supplemented by data from in 
person or telephone interviews conducted with a sample of 100-200 
employers and employees. The interviews should explore in depth 
the areas included on the mail ques tionnaires , with particular 
emphasis on work activity patterns and training and experience 
requirements. Respondents are usually willing to give time for 
an interview, even when they may be quite unwilling to devote a 
lesser amount of time to filling out a questionnaire. Standardized 
interview guides should be prepared so as to insure comparability 
of information from interview to Interview and to questionnaire 
data as well as easy sutrmari zabi 1 i ty of the interview materials 
themsel ves . 

• The cooperation of the Association of Great City Schools should be 
enlisted in order to obtain its assistance in getting responses 
from the large school districts in which a substantial proportion 
of school system R-D-D-E personnel are employed. 

• Federal employee responses should be obtained by interview, with 
the use of a specially designed interview guide since in general 
the type of monitoring activity going on in most Federal agencies 
does not lend itself to appropriate responses to the kinds of 
questions included in the basic questionnaires. 
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• State agencies have been surveyed exhaustively by The Institute 
for Educational Development. It appears that most of the 
information required from State levels can be obtained from 
their analyses and reports, and it is recommended that the final 
survey not include State agencies unless a need becomes apparent later. 
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Appendix A 

AMERICAN EDUCATIONAL RESEARCH ASSOCIATION QUESTIONNAIRE ITEMS 
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Ski 11s Necessary for Research 



1. Drawing research implications from results of prior research studies. 

2. Identifying and delineating significant researchable problems. 

3. Procuring and/or managing resources (material and human) necessary to 
reach research objectives. 

4. Interpreting, evaluating, and synthesizing relevant literature. 

5. Formulating hypotheses or empirical questions to be answered by the study. 

6. Specifying data or evidence necessary for a rigorous test of the 
hypothesi s . 

7. Identifying the population to which results should be generalized and 
a sample representative of that population, using appropriate sampling 
techniques to draw the sample. 

8. Formulating alternative generalizations from predicted research outcomes. 

9. Identifying appropriate research methods. 

10. Understanding experimental, quasi -experimental , and other systematic 
approaches to inquiry, and drawing on such knowledge in designing a 
research study appropriate to the problem under consideration. 

11. Applykng the research design, recognizing, explicating and controlling 
threats to validity. 

12. Identifying classes of behavioral outcomes for measurement. 

13. Choosing specific variables and treatments (where appropriate) to 
be used. 

14. Selecting appropriate techniques of measurement. 

15. Taveloping measuring instruments. 

16. Assessing the validity of outcome measures. 

17. Using a variety of data-gatheri ng methods (tests, interviews, analysis 
of documents, etc.). 

18. Organizing data for analysis. 

19. Understanding the general role, types, and assumptions underlying 
various statistical techniques, and drawing on such knowledge In 
selecting and using appropriate techniques of data analysis. 

20. Using aids in data analyses, such as computer processing. 

21. Interpreting and drawing appropriate conclusions and implications from 
data analyses. 

22. Formulating statements of a theory that offers an expl anation(cause- 
effect relationship) of the behavior under study. 

23. Reporting research findings and implications, orally and In writing. 
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Skllls Necessary for Research-based Development 
( Including Product Testing ) 

1. Interpreting information concerning education goals 

2. Drawing on research results in planning developmental activities. 

3. Conceptualizing systems, their elements, and i nterrelations among 
these elements, 

4. Specifying desired performance outcomes (objectives) of instruction. 

5. Devising techniques to identify entry capabilities of learners, 

6. Identifying alternative instructional and media techniques, 

7. Determining appropriate sequences of topics in instruction. 

8. Describing the product to be developed, 

9. Composing effective oral and written forms of instructional 
communicati ons . 

10. Directing the work of production personnel. 

11. Selecting or devising appropriate techniques for measuring outcomes. 

12. Designing and managing initial laboratory tests of developed techniques 
and materials. 

13. Designing and managing field tryouts and tests, 

14. Reporting evaluation of outcomes, 

15. Interpreting evaluation findings. 

16. Specifying requirements for revision based upon outcome evaluations. 
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Skills Necessary for Diffusion 

Pi s semi nati on 

1. Defining and analyzing characteristics of target group(s) 

2. Selecting from all available information about developed packages 
that which can be most effectively disseminated. 

3. Selecting the most effective dissemination vehicles to convey 
information to target groups. 

4. Composing the information, within a chosen format, for accurate 
and pervasive dissemination. 

5. Implementing actual dissemination, including the direction of technical 
production personnel 

6. Designing and implementing techniques for evaluating the effectiveness 
of the dissemination effort. 



Demonstrati on 

1. Specifying nature of the demonstration, 

2. Selecting appropriate setting and personnel for demonstration. 

3. Managing and coordinating the demonstration effort. 

4. Evaluating the effectiveness of the demonstration. 

Facilitating Adoption 

1. Identifying features of the adopting organization or system which 
differ from those in which the product was developed and tested. 

2. Designing modifications of the product to fit the adopting organiza- 
tion or system, when necessary. 

3. Designing procedures for modifying the adopting system or organization 
to fit the product, when necessary, including the design of needed 
training programs. 

4. Identifying potential barriers to implementation. 

5. Devising and conducting long-range evaluation of the installed 
package. 
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Skills Necessary for Context Evaluation/Situations Analysis 



1. Identifying goals of the system, 

2. Assessing the social relevance of those goals, 

3. Identifying values that are implicit in the system goals, 

4. Identifying the nature of the standards or norms the decision-makers 
will apply in interpreting the relevant data which may be provided. 

5. Clarifying and explicating desired outcomes of the system, 

6. Measuring current actual outcomes of the system through techniques 
such as: 

a. demographic analysis 

b. economic analysis 

c. psychometric analysis 

d. systems analysis 

e. observational techniques 

7. Comparing actual and intended system outcomes to identify discrepancies 
(needs) which exist in the system. 

8. Explicating the problems that create the needs and diagnosing the 
causes of these problems. 

9. Helping system personnel to develop objectives which, if attained, 
will satisfy the needs or solve the problems identified above. 

10. Designing a monitoring system that will provide continual data (of 
the type above) on the status of the operating system. 
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Sk i 11s Necessary for Process Evaluati on/Program Moni toring 

1. Designing and selecting indicators of progress in educational programs. 

2. Monitoring the programs to detect deviations from design or specified 
procedures through techniques such as unobtrusive measures , systems 
analysis, and observational techniques. 

3. Anticipating predicted barriers and remaining alert to unanticipated 
problems that threaten the success of the program. 

4. Providing immediate feedback to program operators for their possible 
use in making decisions about modifications of the plan, procedures, 
or resource allocations. 

5. Perceiving human relation problems that threaten the success of the 
program. 
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Skills Necessary for Outcome Evaluation 

1. Applying appropriate designs to evaluation studies. 

2. Developing general criteria and designing data collection procedures 
for application in measuring the effectiveness and efficiency of 
existing innovative practices and products, i.e., minimum standards 
and outcomes which indicate successful utilization of practices 

and products. 

3. If necessary, translating objectives into behavioral terms. 

4. Identifying situations in which the designated behavior can be 
observed and recorded. 

5. Establishing standards or norms for judging whether objectives have 
been attained. 

6. Selecting (or developing) and using techniques of measurement to 
yield information relevant to these standards, 

7. Assessing the validity of outcome measures. 

8. Collecting and organizing the data preparatory to analysis. 

9. Selecting an appropriate technique to analyze the data, 

10. Analyzing the evidence yielded by the evaluation. 

11. Judging the strengths and weaknesses of the plans and procedures 
employed for meeting the project objectives. 

12. Deciding how to explain the outcome as a function of plans, procedures , 
and resources. 

13. Deciding what recommendations to make as a result of the outcomes. 

14. Estimating the potential impact of the outcomes on the problem area 
being served. 

15. Providing sufficient information to the decision-maker to enable him 
to decide whether to continue, modify, or terminate the activity or 
process evaluated. 

16. Specifying changes that need to be made in the context evaluation 
system due to decisions about program continuation. 
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Skills Necessary for Program PI anni nq/Input Analysis 

1, Helping system personnel to apply criteria to lists of possible objec- 
tives in order to select those which are feasible within constraints 
of the operating context, 

2. Helping system personnel to establish priorities for the selected 
objectives, 

3, Identifying and rating alternative strategies for attaining the 
selected objectives, 

4, Identifying and rating available resources (human, material, and 
financial) and/or potential sources of support. 

5. Selecting a strategy for implementation. 

6. Selecting a source of support or the available resources which will 
be used to implement the program. 

7, Predicting the potential barriers to success in the proposed course of 
action and judging the potential of the strategy for overcoming the 
estimated procedural barriers. 

8. Identifying alternative tactics to implement selected strategy and 
choose those that seem most likely to succeed. 
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Appendix B 

PRETEST EMPLOYER AND EMPLOYEE QUESTIONNAIRES 



STUDY OF EDUCATIONAL RESEARCH, DEVELOPMENT, DIFFUSION, AND 
EVALUATION PERSONNEL TRAINING REQUIREMENTS 



The Far West Laboratory for Educational Research and Development is deve- 
loping a design for a study of training and personnel requirements of employers 
and employees engaged in educational research, development, diffusion, and eva- 
luation (R-D-D-E), The intent of the study is to develop and justify more 
effective plans for the development and support of federally sponsored programs 
designed to respond to requirements for trained personnel (and training capabi- 
lities) in educational R-D-D-E. A "base-line" study, national in scope, techni- 
cally adequate in design, and addressing itself to priority information require- 
ments is needed. 

In order to reduce the burden of response, sampling survey methods will be 
used to select a limited number of educational agencies and federally sponsored 
projects. We have selected your agency or project to pilot test the employer 
questionnaire. We are also requesting your cooperation in helping us to randomly 
sample the professional and paraprofessional staff in your agency or project who 
are engaged in educational R-D-D-E work, so that we may pilot test the employee 
questionnaires. Copies are enclosed for your examination. There are several 
alternate forms which have been designed to cover a wide range of R-D-D— E activi- 
ties, without overburdening individual employees. All data on employers and 
employees will be treated confidentially and will be analyzed and reported only 
by aggregates (e.g. size of funding, type of R-D— D-E work, etc.). 

Because relevant, accessible training programs and training materials are 
important to both employers and employees, wo earnestly request your full coope- 
ration. We are especially interested in your questions or comments which may 
help to improve the questionnaires. 

Please write on the questionnaires themselves, enclose additional written 
comments and questions, or call Dr. Carl Rittenhouse at Stanford Research 
Institute, Area Code 415, 326-6200, Extension 3367. 

PIJ3ASE FILL OUT THIS QUESTIONNAIRE AS SOON AS YOU RECEIVE IT AND RETURN IT 
TO US IMMEDIATELY UPON COMPLETION. 



Del ini i ion of Educu L i otui 1 U< -sea rch 



Educationa I Research is defined ns a so L of coordinated activities which produce 
reliable knowlccl^u that can stand the* tost of empirical verification regarding 
now facts, principles, gent* i , ;ilizal ions , theories, and laws. It employs the* 
procedures of probltMii staling, design, measu route n t and analysis that permit 
known degrees oi gene rn 1 i^.n hi 1 i ty oi findings, and Lhnt. permit nlsu replication 
lor purposes of verification. 



Educational Development is dr* I ined as the syslcmat ic use of lvnoa rcli -^ha sod 
generalisations to <Trat.r new* educational methods, systems, mate* rials, or 
devices which have practical utility. Included in development are the design 
and production of prototype processes and materials and also pilot l rinks to 
tost their feasibility and to gather ideas for their improvement. Development 
mny lx? used to generate new curriculum materials, now touching techniques , 
new types of media, new way^ of assigning pupils to schools, new architectural 
do s i g ns a n d s o a n , 



Educational Di f fusion involves procedures which communicate about, or create, 
the necessary conditions for l lie adoption and utilisation oJ* products which 
derive from educational rest- a roll and development. 



Educational Evaluation is defined by those activities that are necessary for 
determining the effect ivimcwr* of educational programs, products or procedures. 
In its most rigorous form, evaluation wi L 1 lx* concerned with obtaining 
objective measures of effectiveness under highly defined conditions, with 
the ultimate judgment to lx* made against standards or pre-established criteria. 
However, otlie'" procedures also may be? used that yield informal measures such as 
collected opinions and ratings I lint will form the basis of evaluation. 



Educational Planning & Analysis includes tho.se activities through which the 
goals of a system are defined and for which objectives are established that 
are considered to bo feasible* within operating constraints. Objectives are 
priorit.ir.od and the best available* rit.r«tc?gy is determined for their attainment. 
Expected versus actual outcomes may lx; evaluated bv such rigorous techniques 
as economic, systems or psychoinot ric analysis; or, observational techniques 
may be used also Discrepancies arising may be treated by problem diagnosis 
in order to remove blocks to expected outcomes; or, feedback is provided to 
original planning to adjust, proes l ah 1 is he cl objectives. 



IX* fini I i on of Educational Do vo 1 opine n l 



Definition < l Educational Di f fusion 



Definition of Educational Evaluation 



Definition of Educational Planning & Analysis 
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QUESTIONNAIRE A 

Tra L ii i ng a nd Po rsonne 1 Ro qui roi nc n t s 
R— 1>-D— E (Supervisor Quust iumuiirr) 

Name of School District 



Name of Rospondc n t 

Name of Unit Supervised 
by Respondent 

Position Title of Respondent 



Address 



To lephone 



Please describe briefly the kinds of projects in which you typically 
engage and the major functions your unit perforins in the school 
district , 




Place a checkmark Ix^sicU- the type of organization in which the project 



re sid oh : 



Educational R&i) Center 



Ro ional Ed uentiona J 
La ho rate ry 

Col lOKC , School ol Edu = 
ca t ion f Dept . or ol he r 
university oi fico 

Private non “pro lit orga- 
nixat ion 

Industry or commercial 
organizat i on 

Other (specify) 



Public School or School District 

State I Jo pa rtinent of Education 

Pro i'e ssi * mn 1 As s oc in tion 

Agency of I’odora L Government, 
Spec i i y department 



Approximate 
year $ 


1 eve 1 


of 


pro jec 1 


fund i ng 


f rom 


all 


sou re os 


for 


current fisc 


App roximate 
year , 


leve 1 


o f 


pro joet 


fund i nr: 


i rom 


all 


sou re os 


for 


last fiscal 


Anticipated 

$ 


le ve 1 


of 


p ro jec t 


fund i n£ 


f rom 


ail 


sou rcos 


next 


fiscal year 



Approximate percent of current fiscal year project funds from * 

_ _ % ILS* Office of Education 

JTc Office of Economic Opportunity 

Nat it ) na 1 Sc i a nee Ecu net a t i o n 

r b Other federal agencies (specify) 

% State ( H pc: v i f y ) 

% Priva to Kou nd a t i o n 
% Local School Dintric t 
% I nriu s t ry 

.n O t he r ( spec: i f y ) 

i 

PLEASE ASSURE THAT ABOVE PERCENTAGES ADD TO 100 7c. 

o 
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1. in order to classify your project, which may involve several educational 

research, development, diffusion, evaluation or related planning and management 
tasks, please est inui to the pc rcent of current fiscal year project or unit effort 
which is being expended in the following areas. Show 0*'r if no effort in a given 
activity* Please rend all items before answering. 

1 , Conduct i ng basic scientific inquiry related to educational 

problems . 

2, Conduct i ng applied research studies directly related to 
educational p ruble ms . 

3, Investigating and assessing educational needs and requirements. 

4, Gathering ami providing information lor program planning 
and design. 

5, Locating and evaluating programs or procedures that may provide 
solutions to operating problems* 



6. So loci i ng , adapting or invent i ng sului joins to operating problems. 

7. Developing proiotvpic packages (innovative solutions and 
programs) lor educational programs, 

8. Testing and evaluating innovative solutions and programs. 

9. Revising and refining protolypic packages on the basis of 
test and evaluation i u i o rma t ion . 

10, Creating widespread await* ness of tested solutions and programs. 

11, Demonstrating effect ivonuss of solutions and programs to 
target audiences. 

12, Training target audiences in the use of solutions nnd programs* 

13, Monitoring and adjusting solutions and programs alter or during 

widespread installation. 




Planning and programming any of tlu* above activities. 
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15, 

Itt. 



17. 
IS . 



Managing and supervising any of t ho above activities. 

Such ring funding tor, financially planning, and uccuiint i for 
re sun rues and expend i tu res of any of Liu? above. 

Preparing reports, documontai ion, etc. , on any of the above* 
OLlier (spec 1 f y 



19, Training pro Jccl ' agency personnel to perform any of the above. 
Please list numbers of activities above to which training applies 

20, Training o t he r than p ro Joe t /agency personnel to perform any of 
tiie above. Please list numbers of activities above to which 

t ra i ti i ng a p p 1 ies : 

Pie a s e also s pe c i f y t y pc < > f pe v s o nue I : ^ _ ____ 



PLEA St ASSURE THAT ABOVE PERCENTAGES ADD TO 100%. 
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Are there* skills or sensitivities Lhat have boon particularly difficult 
to find in recruiting? Please describe. 



3, Have you had difficulty in recruiting personnel with qualifications in 
specific content areas such as early childhood education, minority 
education, remedial reading, vocational education or others? Please 
specify areas. 





= (5 = 



4. Listed !>e low arc a number of roc ru i t i ng proeodu ros , Ft is t f place a 
checkmark in the left hand column by those you have used. Next, lor 
each one that is checked* indicate degree o t effectiveness by placing 
a checkmark in thc.‘ appropriate column. 



Recruit ing Procedures 

A, Journal or newspaper 
ad ve i*t is ing 



I Have j 
Used ! 



E I' fee i i venoss o l roc ni_i ting procedure? 1 



| Minimally ! 

i Effective 
i. - . — . — r 



Mode rate I y 
Ef fee t i ve 



Vo ry 

E f fee t i vc 



B. Professional meeting 
emp toymen l so rv ices 

C . Ro terra 1 by o t he r 
employees 

B. Colleges and university 
employ me n t s e rv i c.*e s 

E. Informal survey of 
professional col leagues 

F. Review of unsolicited 
app 1 ications 

G. Recruitment from 
wi t hi n 

H. Other (specify ) 



i 

i 



i 



i 

i 



i 



i 



) 
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5, Listed below are a number of selection techniques, First, place a 
checkmark in the left hand column by each technique you have used. 
Next ; for each one that is checked , indicate degree of effectiveness 
by placing checkmark in the appropriate column* 



Effect! vo ness of 
Selection Techniques 



Se lection 
Techniques 


Have 

Used 




j Minimal ly 
! Effective 


I 

Moderately 
! Effective 


i ' ' * i 

Ve ry 

: Effective j 


A * Interviews 






; i : 

1 1 


i i 

! _ j 


B, Tests 






1 

1 

[ 




: i 

I 


C* Application 










j 


blanks 












D. References 












i 

i 

E, Work samples 


: - 1 










F P Other (specify) 








— 





Please comment on any special problems in using the selection techniques* 
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6, Below is a list of personnel cu t egorios arranged by level of responsibility. 

Director or principal investigator 

Pull rosponsibi 1 ity for a program or a largo scale project 

Research and Development Associate 

Pull responsibility lor medium size and smaller projects 

Research and Development Assistant 

Responsibility under supervision for some part of a project, 
such as for data collection and reduction 

Research and Development Intern 

Carries out assigned specific tasks under supervision 

Te clinician 

Carries out assigned specific tasks requiring little or no technical 
skill u nd e r supe rv i s i o n 

Clerical 



Please complete the table below in accordance with the following instructions: 

Under Section A, indicate in the appropriate columns the nur, ber of individuals 
you employ and the number ol full time equivalent (I'TE) employees repre- 
sented by those individuals* If none, write () in the space. 

Under Section B, indicate what in your opinion should be the minimum combination 
of education and experience requirements for each category by degree and by 
years of experience. 

Under Section C. place a checkmark ( WO opposite those categories for which 

your organization has established formal education and experience require- 
ments. Then, for those you have checked, describe the requirements 
(e.g.j Program Associate - minimum of Master’s degree and 3 years ol 
experience, and so forth) in the space provided be low. 



Section A 


Section D 


So c t i o n C 


r 

Employees 


Requi remonts 
in your Opinion 


Organizational ! 
Requi remonts j 


Number , p T p 

Personnel Categories = Employed 


! Ye a rn o f 
Degree ; „ 

! Experience 

i - - 


“ ~ ‘ T 

Formal j 

Requirements I 

L___ — i 


Director and Principal j 

Inves t ign tor j 


1 

i 


1 

i 


. i 

H&D Associate ! 


i 

i 


H&D Assistant 1 1 


.... j 

i 


R&I) Intern ' j ' 




1 1 : 

R&D Technician , 




RM) Para pro fessiona L : 


I 




Clerical 


i 

1 





for describing formal requirements under Section C instructions. 



O 
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7 , 



How adequately has the previous training nr experience 
employees prepared them for their present assignments? 
checkmark (^) opposite each personnel category and in 
appropriate column that reflects your judgment of past 
or training. 



of your 
Place a 
t he 

experience 



Adequacy of Previous Training and Experience 



Personnel 

Categories 


| Highly I n - 
| adequate 


~ " j 

Inade- Unde- 
quale elded 


f 

| Adequate 


High 1 y 
Adequa 


R&L) A s soc i at e 


i 


i 






K&D Assistant 




; j 

I » j 


| 




n&n intern 


i 

i 


| 






R&D Technician 


j 

[ 


i 






j 

R&D Paraprof essional 


1 


l 

i 

^ ( 






j 

Clerical ! 


| 


! i 1 

! I 




i 

i 




l i 1 
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8* Listed below are several kinds of in-house employee training. 
Check those you have used during the past year. 

Used During 

in-house Employee Training Past. Year 



A . 


Special 


super vi 


sed OJT or internship j 

i 


B . 


One to 


two week 


short courses ! 

| 


C . 


One to 


five day 


seminars or institutes 1 

i 


D . 


Lon go r 


course s 


| 

i 


E . 


Other (specify) 


1 



For those you checked above, briefly indicate the number of times 
it was offered, the percent of your employees who were enrolled, 
the time required and a description of the content including course 
titles if possible (e,g,, two week course in Tests and Measurements, 
3 hours per day, 25^ of the staff enrolled, offered 4 times during 
past year) . 
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Listed below arc 30 activities that are performed in educational R-D-D-E. 

Under Section A, indicate the need for additional training- for your employee?. 



Place a checkmark in the appropriate column opposite each activity. Under 
Section B, identify f 1 ve activities for which you would like to have programmed 
instruction or other self-study materials developed. Next, rank the five 
activities you have selectcMl from ,f l ,f to ’’o', with Rank f, l" going to the one 
with your highest pro fore nco, Rank M 2 M to your next highest preference and so 



fort h , 



Educational R -D-D — E 
Ac l ivities 



1. Interpreting, evalu- 
ating a net s v n t lie s i z - 
ing relevant 1 it© ra- 
ti u re 



Need for Training 



Section A 



Little or Moderate Great 
no need , need need 



Ma te i*i u 1 s Pe s i red 



\ 



Section U 



Rank of activities for 



which training materials 
are desi reel 



2. Identifying and delin- 
eating significant 
resea reliable problems 

3. Choosing specific re- 
search variables and 
treatments (where ap- 
propriate) to be used 

1. Developing measuring 
1 net rumen is 

3 . Us i ng a v a i i e t y o I 

dat a -go t he ring me t hods 
(tests, interviews, 
analysis of documents, 
etc.) 

CL Organizing data Jor 
ana lys i s 

7, Understanding the gen- 
eral role, types, a nd 
assumptions unde rlying 
various statistical 
techniques, and drawing 
on such knowledge in 
selecting and using ap- 
propriate techniques of 
data analysis 



i 

i 



\ 

1 

i 



i 



i 

| 





i 

I 

\ 

i 

I 

I 








Nee d i o r T i *a 1 n i ng 



Ma t e r i a 1 s De' s l re d 



Educational R-D-D-E 
Ac 1 i vi t ies 



H, Using aids in data 
analysis, s u c 1 i as 
computer processing 

9, Interpreting ami 

c! raw i ng app ru p r i n t e 
conclusions and im- 
plications from data 
a na 1 y se S 

10. Reporting research 
findings and implica- 
tions, orally and In 
writing 

11. Specifying desired 
performance outcomes 
(objectives) of 

ins t ruction 

12. Describing a product 
to lie dove loped 

1 3 # De s i g n i ng a nd ma nag - 
i ng field tryouts and 
tests 

11* Specifying require* 
ments for product 
revision based upon 
outcome? evaluation 

1 5 . Se 1 o c 1 i ng t he mos t 

e C fo c t i ve d i s sen 1 n a — 
tion vehicles to 
convey information 
to target groups 

lb. Com post ng the in for* 
mat: Lon, within a 
chosen format, for 
accurate and perva- 
sive d isseminnt ion 



Sect ion A 

Little or Moderate Great 
no need need need 




i 



I 

j 

i 



Section D 

Rank of activities for 
which training materials 
are desired 



o 

ERIC 
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Erturational R-D=D-E 
Act i vi ties 



17» Imp leme n t i n g act u a 1 
d i ssemi na t i on , in- 
cluding the direc^ 
tion of technical 
production personnel 

18. Identifying goals of 
an educational system 

19. Clarifying and oxpli- . 
eating desired outcomes 
oi an educational sys- 
tem 

20. Comparing actual and 
intended educational 
system outcomes to 
identify discrepancies 
(needs) which exist 

in the system 

21. Designing a monitor- 
ing system that will 
provide continual data 
on the status of an 
operating educational 
system 

22. Helping educational 
system personnel to 
establish priorities 
For selected system 
oh.jee t Ives 

23. Identifying and rating 
alternative strategies 
for attaining selected 
educational system 

o b jec t i ve s 

2d. Identifying and rating 
ava liable educations 1 
p ro g ra in resources 
(human, material and 
financial) and/or poton 
tial sources o f support 



Need for Training 



1 

Sect ion A 


Little orj 
no need ! 


Mode rate ! 
need 


G re a 1 1 
need ; 












1 


i 

i 

1 






i 

j 

j 






i 

! 

s 

i 

i 

i 






I ■ ■— 

i 

! 

i 

i 






1 


i 

j 


i 

! 

1 




! 


t 

1 



Materials Desi red 



; Section B 

Rank of activities for 
which training materials 
| are desired 

i ■ — ■ — — ■ — ■ 

! 

i 



1 

! 

i 



25, 

o 

ERIC 



Writing proposals for 
research, development ? 
discern i nation and/or 

evaluation projects 



i 



56 
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Educational R-D-D-E 
Ac ti vities 



26, Monitoring educational 
p rog ram s to detect de- 
viations from design 
or specif i led procedures 
through techniques such 
as u no b t ru s 1 ve me a s u vo s , 
systems analysis, and 
obse rva t i ona 1 toe hn i ques 

27. Developing general | 

c i’ i. Leris a nd design- j 

ing data collection 
procedures for appii= 
cation in measuring 

the effectiveness and j 

efficiency of exist = { 

ing innovative prac- 
tices and products, 
i.e,, minimum stan- 
dards and outcomes 
which i rid i cate suc- 
cessful utilization 
of practices and 
produc t s 

2 8. If ne ce s s a ry * trans- 
lating program ob- 
jectives into behavior- 
al terms 

29. Establishing standards 
or norms for judging 
whether objectives 
have been attained 

30, Selecting (or devel- 
oping) and using tech- ) 

niques of measurement ! 

to yield information | 

re le vnnt to s t a nd a rd w j 
to be used j 



Need for Training 



Sect ion A 


Little or 
no need 


| Moderate 
i need 

i 

i 


! G re a t 
J need 




Materials Desired 



Section B 

Rank of activities for 
which training materials 
are desired 



fl 

I 

i 

j 

— i 

b 

e 

i 

j 

i 

i 

i 

I 

i 




ET 



?? 



i 
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llow much value do you place on the following t ruining approaches lor current 
Place a check mark in the appropriate "value" column 



L'nip ioyeen? 



Training Approaches 

A. Three to five day institutes or seminars 

B . XjO nge r i ns l i t u t e s 

C. One to two week short omt rses 

j). Longer courses 

K* Internships in oilier agencies 

B * Correspondence courses 

CK Extension or other course ;i mingeinenl s 
with colleges nr u uive i\s i ( i os on a 
released time basis 

11 . Ex tension or other course a rrmigeinen t s 
with colleges or universities on an 
employee's own time 

I. Other (sped 1 y ) 



Value of Approach 

(Li It lo or Moderate j G re a t j 
Mut value | Value » Value j 




i 



I 



o 

ERIC 
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11. Indicate for each personnel category the number of currently unfilled positions, 
the number of losses in the last year and the number of personnel added in 
the last year* (II none, write "none" opposite the appropriate category.) 



Personnel Categories 

Director and Principal Investigator 

R&D Associate 

R&D Assistant 

R&D Intern 

R&D Technician 

R&D Paraprofcssional 

Clo rical 



Indicate 


major 


reasons 


for 


current vacancies, if any* 




Indicate 


major 


reasons 


f o r 


losses, if any. 




Ind icate 


major 


reasons 


for 


additions, if any* 





Number 






current j 


Numbe r 


Number 


unfilled 


Losses in 


additions 


positions 


last year 


j last year 


] 

i 
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12, 



How many employees do you anticipate hiring in the 
1 O 1 lowing levels? (II none, write M nwne M opposite 



1 * 1 two yon rs for onch of 

1 he appropriate category ) , 



t he 



^Personnel Categories Wumbor to be Hired 

Director and principal investigator 

H&D Associate 

R&D Assistant 

mn I ii tern 

R&D To c h ni o l a n 

R&D Pa rap rofessioila 1 

C le rica 1 



13. 



If your funding were to bo increased by half (50% more tium current funding) 
in the next year: 



A* How many people would you need in addition to present staff and 
at what levels? (e.g., "3 R&D associates'*) 



Hi What kinds ol skills would 
statistical ana 1 vs i s ) 



they re present: ? 




Co , g, , 



proposal writing 
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14. Please list alphabetically all the personnel <'XW)» clerical win. work in the 

unit or on the project. Then follow the steps discus. sort on the following page 
for selecting personnel who will complete Questionnaire D. 



PIiEASE USE THE LAST PAGE TO COMMENT ON THE QUESTIONNAIRE 



o 
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PROCEDURE FOR SELECTING QUESTIONNAIRE K RESPONDENTS 



Alter you have listed all personnel will! the exception of those in clerical 
positions, four individuals should bo chosen who will complete the Form B 
(Employee) Questionnaires, In order that a random group will be chosen, we 
ask that you follow the procedure shown below. 



Step #1 


Starting with Number 1 I'or the first name on the list, 
number all remaining names consecutively . 


Step #2 


Divide your total number o; mployees by Ion r * This 

will give you o quotient, and a remainder in some instances. 


Step #3 


Use the remainder as a means of locating the first individual 
to be selected, i„e,, if the remainder is 3, count down to the 
third individual from the top of the list. 


Step #4 


Use the quotient to select the remaining three people, i.e., 
Hf fhp qnntinnt: is two f take every second person after the 
initial person has boon selected according to Step #3. In 

this case you would continue selecting every second person 
until three have been identified. 

If you have four, or a lesser number i>n your staff, then all 
of them would be requested to complete the questionnaire. 


For 

Examp le ; 


Example #1 

Staff size of 13 divided by four equals a quotient of 3, 
re m a i mi or of 1 , 

With a remainder of 1, the first name on the list is 
chosen initially. With a quotient of 3, count down 
to the third nnme below the one already chosen, or 
name # -1 on the list. Continue taking every third name 
until a total of four have been selected. 

Example #2 

Staff size of 6 divided by 4 equals a quotient of 1, 
remainder of 2, 

As the first step, select the second name on the list* 
Thereafter, take the next three consecutive names, 
since the quotient equals 1* 



' £2 



PLEASE USE THE I.AST PAGE TO COMMENT ON THE QUESTIONNAIRE 



- 20 “ 



Cumme nts on t ho Questionnaire 



Since this questionnai 
form fur use throughou 
your comments on its c 
you have made. Please 



ru is being tested before preparation in 
t t lie- country with educational R-D-D-E pe 
ontont and formal are as valuable as the 
comment as frankly as you desire. 



its final 
rsonne 1 , 
responses 



For each comment > p lease reference 
make the appropriate changes (e.g. 
t he meaning of no t i v i t v # — , — - 

understand what I was supposed to 



the page and item mi in be r so 
, page t item , could 

" ; or, page ♦ itom 

do", and so on. 



that we can 
not understand 
'‘could not 
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STUDY OF EDUCATIONAL RESEARCH, DEVELOPMENT , DIFFUSION, AND 

evaluation personnel training requirements 

The Far West Laboratory for Educational Research and Development is deve- 
loping a design for a study of training and personnel requirements of employers 
and employees engaged in educational research, development, diffusion, and eva 
luation (R-D-D-E), The intent of the study is to develop and justify more 
effective plans for the development and support of federally sponsored programs 
designed to respond to requirements for trained personnel (and training capabi- 
lities) in educational R-D-D-E, A "base-line study, national In scope, tecj li 
cully adequate in design, and addressing itself to priority information require- 

merits is needed. 

In order to reduce the burden of response, sampling survey methods will be 
used to select a limited number of educational agencies and federally sponsored 
projects. We have selected your agency or project to pilot test the employer 
questionnaire. We are also requesting your cooperation in helping us O ran on 
sample the professional and paraprofossional staff in your agency or project who 
are engaged in educational R-D-D-E work, so that we may pilot test the employee 
questionnaires. Copies are enclosed for your examination. There are several 
alternate forms which have been designed to cover a wide range of R D D-E activl 
ties without overburdening individual employees. All data on employers and 
employees will be treated confidentially and will be analysed and reported only 
by aggregates (e.g. size of funding, type of R-D-D-E work, etc,). 

Because relevant, accessible training programs and training materials are 
important to both employers and employees, we earnestly request your full coope 
ration^ ^ We are especially interested in your questions or comments which may 
help to improve the questionnaires* 

Please write on the questionnaires themselves, enclose additional written 
comments and questions, or call Dr. Carl Rittenhouse at Stanford Researc 
Institute, Area Code 415, 326-6200, Extension 3367. 

PLEASE FILL OUT THIS QUESTIONNAIRE AS SOON AS YOU RECEIVE IT AND RETURN IT 
TO US IMMEDIATELY UPON COMPLETION. 



3 
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Deli nit ion of Educational lie search 



Educational Research is defined as a set of coordinated activities which produce 
reliable knowledge that can stand the test of empirical verification regarding 
new facts, principles, generalizations, theories, and laws. It employs the 
procedures of problem stating, design, measurement and analysis that permit 
known degrees of geiieralizabi lity of findings, and that permit also replication 
for purposes of verification. 

Definition of Educational Development 

Educat ional Development is defined as the systematic use of resea rch^based 
generalizations to create new educational methods, systems, materials, or 
devices which have practical utility. Included in development are the design 
and production of prototype processes and materials and also pilot trials to 
test their feasibility and to gather ideas for their improvement. Development 
may be used to generate new curriculum materials, now teaching techniques, 
new types of media, new ways of assigning pupils to schools, new architectural 
designs and so on. 

Definition of Educational Diffusion 

Educational Pi f fusion involves procedures which communicate about, or create, 
the necessary conditions for the adoption and utilization of products which 
derive from educational research and development. 

Definition of Educational Evaluation 

Educational Evaluation is defined by those activities that are necessary for 
determining the effectiveness of educational programs, products or procedures. 

In its most rigorous form, evaluation will be concerned with obtaining 
objective measures of effectiveness under highly defined conditions, with 
the ultimate judgment to be made against standards or pre -established criteria. 
However, other procedures also may be used that yield informal measures such as 
collect ed opinions and ratings that will form the basis of evaluation. 

Definition of Educational Planning & Analysis 

Educational Planning & Analysis includes those activities through which the 
goals of a system are defined ~and for which objectives are established that 
are considered to be feasible within operating constraints. Objectives are 
prioritized and the best available strategy is determined for their attainment. 
Expected versus actual outcomes may be evaluated by such rigorous techniques 
as economic, systems or psychometric analysis; or, observational techniques 
may be used also. Discrepancies arising may be treated by problem diagnosis 
in order to remove blocks to expected outcomes; or, feedback is provided to 
original planning to adjust preestablished objectives. 



' 05 
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QUESTIONNAIRE A 

Training and Personnel Requirements 
R-D-D-E (Project Director Questionnaire) 



Project Tit le 
Project Director 

Position Title 

Address 



Te le phone 



Agency Receiving Contract or Grant 
Agency Director and Title_ 



Address 



Te le phone 

Sponsoring/Fund ing Agency 

Agency Department 

Project Officer ___ 

Primary Project Objective 



G6 



Starting Date of Project 
Ending Date of Project 



O 
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Place a checkmark beside the type of organization in which the project 
resides : 



Educational R&D Center 

Regional Educational 
Laboratory 

College, School of Edu- 
cation, Dept* or other 
university office 



Private non-profit orga- 
nization 

Industry or commercial 
organization 

Other (specify) 



Public School or School District 

State Department of Education 

Professional Association 

Agency of Federal Government, 
Specify department 



Approximate 

year 


leva 1 


of 


project 


funding 


f rom 


all 


sou rccs 


for 


current fiscal 


Approximate 


lave 1 


of 


project 


funding 


from 


all 


sources 


for 


last fiscal 


year ^ 




















Anticipated 


level 


of 


project 


funding 


from 


all 


sources 


next 


fiscal year 


$ 





















Approximate percent of current f i s c a 1 year project funds from; 
% U.3. Office of Education 

% Office of Economic Opportunity 

% National Science Foundation 

% Other federal agencies (specify) 

% State (specify)^ ^ 

% Private Foundation 

% Local School District 
% Industry 

% Other (specify) 

PLEASE ASSURE THAT ABOVE PERCENTAGES ADD TO 100.%, 

o 
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In order to classify your project, which may involve several educational 
research, development, diffusion, evaluation or related planning and management 
tasks, please estimate the pe rcent of current fiscal year project or unit effort 
which is being expended in the following areas. Show 0% if no effort in a given 
activity* Please read all items before answering. 

1 • Conducting basic scientific inquiry related to educational 

problems , 



3. 

4. 

5 . 

0 . 

7. 

8 , 
9, 

10 , 
11 . 

12 . 

IS. 

14* 



Conducting applied research studies directly related to 
educational problems. 

Investigating and assessing educational needs and requirements. 
Gathering and providing information for program planning 
and design. 

Locating and evaluating programs or procedures that may provide 
solutions to operating problems* 

Selecting, adapting or inventing solutions to operating problems. 
Developing prototypic packages (innovative solutions and 
programs) for educational programs. 

Testing and evaluating innovative solutions and programs* 

Revising and refining prototypic packages on the basis of 
test and evaluation information. 

Creating widespread awareness of tested solutions and programs. 
Demonstrating effectiveness of solutions and programs to 
target audiences. 

Training target audiences in the use of solutions and programs. 
Monitoring and adjusting solutions and programs after or during 
widespread ins t a 1 la t ion. 

Planning and programming any of the above activities. 
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15. Managing and supervising any o J’ the above activities ♦ 

ie> Securing funding for, financially planning, and accounting for 

resources and expenditures ol any of the above. 
ly Preparing reports, documentation, etc., on any of the above. 

18, Other (specify - — — 



Training project/agency personnel to perlonn any ot the above. 
Please list numbers of activities above to which training applies 

Training other than project/agency personnel to perform any oi 
the above. Please list numbers of activities above to which 
training applies : 

Please also specify type of personnel: — 



PLEASE ASSURE THAT ABOVE PERCENTAGES ADD TO 100%. 




df 
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2, Are there skills or sensitivities that have been particularly difficult 
to find in recruiting? Please describe. 



3, Have you had difficulty in recruiting personnel with qualifications in 
specific content areas such as early childhood education, minority 
education, remedial reading, vocational education or others? Please 
specify areas. 
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4 , Listed below are a number of recruiting procedures , First, place a 
checkmark in the left hand column by those you have used- Next* lor 
each one that is chocked, indicate degree of effectiveness by placing 
a checkmark in the appropriate column. 



Recruiting Procedures 

A. Journal or newspaper 
adve rt is ing 

B. Professional meeting 
employment services 

C. Referral by other 
emp loyees 

D. Colleges and university 
employment services 

E* Informal survey of 

professional col leagues 

F, Review of unsolicited 
app lieations 

G , Recru i tme n t f rom 
wit hin 

H, Other (specify) 



Have 

Used 




Effectiveness of recruiting procedures 


M i n i in a 1 1 y ! Mo d e r a t o 1 y 
Effective i Effective 


Ve ry 

■ Effective: 


i 

j 

i 


i 

i 


i 

i 

j 


" i 

i 

j 

i 


, j 


i 

i 


\ 


i 

i 

i 

i 


i 

! 




! 

i 

i 


i 

i 

l i 

1 
i 


i 

i 




- j 

i 





o 
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5, Listed below are a number of select ion techniques . First^ place a 
checkmark in the left hand column by each technique you have used . 
Next j for each one that is checked , indicate degree of effectiveness 
by placing checkmark in the appropriate column. 



Effectiveness of 
Selection Techniques 



Se lection 
Techniques 


Have 

Used 


| 


1 

; Mi nimal ly 
; Effective 


i 

! Moderately 
Effective 


Very 

Effective 


A. Interviews 




j 


i 






B, Tests 




i 


f 

I 






C* Application 




1 


t 






blanks 












D. References 












E. Work samples 












F. Other (specify) 













Please comment on any special problems in using the selection techniques 



r 
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6. Below is a list of personnel categories arranged by level of responsibility, 

m Director or principal investigator 

Full responsibility for a program or a large scale project 

• Research and Development Associate 

Full responsibility for medium size and smaller projects 

• Research and Development Assistant 

Responsibility under supervision for some part of a project, 
such as for data collection and reduction 

• Research and Development Intern 

Carries out assigned specific tasks under supervision 

• Technician 

Carries out assigned specific tasks requiring limited 
technical skills under supervision 

• Paraprofessional 

Carries out assigned specific tasks requiring ii-tle or no 
technical skill under supervision 

• Clerical 



Please complete the table below in accordance with the following instructions: 

Under Section A, indicate in the appropriate columns the number of individuals 
you employ and the number of full time equivalent (FTE) employees repre- 
sented by those individuals. If none, write 0 in the space. 

Under Section B. indicate what In your opinion should be the minimum combination 
of education and experience requirements for each category by degree y 

years of experience. 

TTnHer Section C, place a checkmark OO opposite those categories for which 

your organization has established formal education and experience require- 
ments Then, for those you have checked, describe the requirements 
(e .g. ’ Program Associate - minimum of Master’s degree and 3 years of 
experience, and so forth) in the space provided below. 





Section A 


Section B 


Section C 




Employees 


Requirements 
In your Opinion 


Qrganizati onal 
Requirements 


Personnel Categories 


Number 

Employed 


FTE 


Degree 


Years of 
Experience 


Formal 

Requirements 


Director and Principal 
Investigator 

RM3 Associate 

RM) Assistant 

RM> Intern 

RSJD Technician 

r&D Paraprofessional 






















i -- 

i 




i , — = — — 






! 










i 




















I ,u 










Clerical 


i 

• 


X 









For describing formal requirements uri^er Section C instructions. 
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- How adequately has the previous training or experience 
employees prepared them for their present assignments? 
checkmark ( w^) opposite each personnel category and in 
appropriate column that reflects your judgment of past 
or training. 



of your 
Place a 
the 

experience 



Adequacy of Previous Training and Experience 



Personnel 

Categories 


Highly In- 
adequate 

i 


T 

| Inade- 
quate 


I Unde - 
| cided 


Adequate 


Highly 

Adequate 


R&D Associate 






T 

i 






R&D Assistant 












RM) Intern 












R&D Technician 












RM) p a r a p r o f e s s i on a 1 












Clerical 












1 
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8 . 



Listed below are several kinds of in-house employee training. 
Check those you have used during the past year . 

Used During 

In-house Employee Training Past Year 

I 

A. Special supervised OJT or internship ____ 

B . One to two wee, short courses ____ 

C. One to five day seminars or institutes 

D. Longer courses 

E. Other ( specify) _ 



For those you checked above, briefly indicate the number of times 
It was offered, the percent of your employees who were enrolled, 
the time required and a description of the content including course 
titles if possible ( e . g , , two week course in Tests and Measurements, 
3 hours per day, 25% of the staff enrolled, offered 4 times during 
past year) . 
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9, Listed below are 30 activities that are performed in educational R-D-D-E, 

Under Section A, Indicate the need for additional training for your employees. 
Place a checkmark in the appropriate column opposite each activity. Under 
Section B, identify five acti vltles for which you would like to have programmed 
instruction or other self-study materials developed. Next, rank the five 



activities you have selected from "l" to "s", 



with Rank l" going to the one 



with your highest preference, 



Rank 2 M to your next 



highest preference and so 



forth , 



Need for Training 





Section A 


Educational R-D-D-E 
Activities 


Little o 
no need 


r Moderate 
need 


t 

> ! Great 
t need 

i 


1# Interpreting, evalu- 
ating and synthesiz- 
ing relevant litera- 
ture 






“f 


2, Identifying and delin- 
eating significant 
re searchable problems 








3^ Choosing specific re- 
search variables and 
treatments (where ap- 
propriate) to be used 








4, Developing measuring 
instruments 








5, Using a variety of 

data-ga thering methods 
(tests, interviews, 
analysis of documents, 
etc * ) 








G, Organizing data for 
ana lysi s 








7. Understanding the gen- 
eral role, types, and 
assumptions underlying 
various statistical 
techniques, and drawing 
on such knowledge in 
O selecting and using ap - | 

propriate techniques of j 
hnmiBMrimra data analysis 






! 

i 

i 

! 

! 

1 



Materials Desired 
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Ed neat ion a 1 R-D-D-E 
Ac t i v 1 1 ies 



8, Using aids in data 
analysis, such as 
computer processing 

9. Interpreting and 
drawing appropriate 
conclusions and im- 
plications from data 
a nn lyses 

10, Reporting research 
findings and implica- 
tions, orally and in 
writing 

11, Specifying desired 
performance outcomes 
(objectives) of 
inst ruction 

12, Describing a product 
to be developed 

13, Designing and manag- 
ing field tryouts and 
tests 

14, Specifying require-^ 
ments for product 
revision based upon 
outcome evaluation 

15, Selecting the most 
effective dissemina- 
tion vehicles to 
convey information 
to target groups 

16, Composing the infor- 
mation, within a 
chosen format, for 
accurate and perva- 
sive dissemination 



Need fo r Tra i ni ng 



I Section A 

i Little or Moderate. Great 

no need | need I need 

! i 

? - - i f 

i 




i 



i 

i 



i 



Materials Desired 



! Section B 

r~ ■ ” ” ' 

! Rank of activities for 
i which training materials 
are desired 



t 

i 

I 



| 

i 

i 



j 



I 

I 



i 

i 



i 

i 

f 

I 



o 
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Need for Training 





Section A 


Educational R-D-D-E 
Act ivities 


Little orl 
no need 


Moderate 
■ need 


Great 

need 


17. Implementing actual 

dissemination, in- 
cluding the d i re c - 
t 1 on of technical 
production personnel 

18* Identifying goals of 

an educational system 














19. Clarifying and expli- 
cating desired outcomes 
Of an educational sys- 
tem 








20. Comparing actual and 
intended educational 
system outcomes to 
identify discrepancies 
(needs) which exist 
in the system 








21. Designing a monitor- 
ing system that will 
provide continual data 
on the status of an 
operating educational 
system 








22. Helping educational 
system personnel to 
establish priorities 
for selected system 
ob ject ives 








23, Identifying and rating 
alternative strategies 
for attaining selected 
educat ional system 
objectives 


r I 






24 * Identifying and rating 
available educational 
program resources 
(human, material and 
financial) and/or poten- 
tial sources of support 


! 






25. Writing proposals for 
research, development, 
dissemination and/or 

evaluation projects 


i 

i 


1 


i 






Materials Desired 



J Section R 

I Rank of activities for 
which training materials 
are desired _____ 
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vialions from design 
or specif iied procedures 
through techniques such 
as unobtrusive measures, 
systems analysis, and 
observational techniques 

27 * Developing general 

criteria and design- 
ing data collection 
procedures for appli - 
cation in measuring 
the effectiveness and 
efficiency of exist- 
ing innovative prac- 
tices and products, 
i .e . , minimum stan- 
dards and outcomes 
which indicate suc- 
cessful utilization 
of practices and 
products 

28 . If necessary, trans- 
lating program ob- 
jectives into behavior- 
al terms 

29. Establishing standards 
or norms for judging 
whether objectives 
have been attained 

30. Selecting (or devel- 
oping) and using tech- 
niques of measurement 
to yield information 
relevant to standards 
to be used 




Educational R-D-D-E 
Activities 



26. Monitoring educational 
programs to detect de- 



Head for Training 



Section A 



Little ori Mode rate! Great 
no need ! need need 
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10. How much value do you place on the following training approaches for current employees? 
Place a check mark in the appropriate "value" column 

Value of Approac h 



Training Approaches 


[Li tile or 
jno value 


Mode rate 
Va lue 


Great 

Value 


A, 


Three to five day institutes or seminars 


r~ 






B, 


Longer institutes 




i 


i — 

* 

; 1 


C. 


One to two week short courses 




! ' : i 

• ! 


Di 


Longer courses 


i 

i 

| 


I 




E. 


Internships in other agencies 








F* 


Correspondence courses 


1 

i 

I 






G, 


Extension or other course arrangements 
with colleges or universities on a 
released time basis 








H. 


Extension or other course arrangements 
with colleges or universities on an 
employee’s own time 








I. 


Other (specify) 










8 



0 
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11 . 



Indicate for each personnel category the number of currently unfilled positions, 
the number of losses in the last year and the number of personnel added in 
the last year. (If none, write "none" opposite the appropriate category.) 



I 

Personnel Categories 

Director and Principal Investigator 
R&D Associate 
R&D Assistant 
R&D Intern 
R&D Technician 
E&D Paraprofessional 
Clerical 



Number 
current j 

unfilled 
positions 


i Numbe r 

| losses in 

| last vear 


Number j 
additions in j 
last year j 


_ 


i 

! 


i 


i 


i 


1 j 


! 

! 




i 

t 


i 


! 

1 

| 




j 


i 

I 






i 



Indicate major reasons for current vacancies, if any. 



Indicate major reasons for losses, if any* 



Indicate major reasons for additions, if any- 



81 
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12* How many employees do you anticipate hiring in the next two years for each of the 
following levels? (If none, write "n one" opposite the appropriate category). 

Personnel Categories Number to be Hired 

Director and principal investigator ___ 

R&D Associate ___ 

R&D Assistant 

B&D Intern _ 

R&D Technician 

R&D Pa raprofessional 

Clerical _____ 



13, If your funding were to be increased by half (50% more than current funding) 
in the next year: 

A, How many people would you need in addition to present staff and 
at what levels? (e*g«, "3 R&D associates’ ) _____ 



B, What kinds of skills would they represent? (e , g. , proposal writing, 
statistical analysis) 
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14 Please list alphabet ical lv all the* personnel except cL*rit:ni who work in the 

unit or on the project, i'lion iol Low the steps discussed on the following page 
for selecting personnel who will complete Questionnaire If 



PLEASE USE THE LAST PAGE TO COMMENT ON THE QUESTIONNAIRE 
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PROCEDURE FOR SELECTING QUESTIONNAIRE D RESPONDENTS 



After you have listed all personnel with the exception of those in clerical 
positions, four individuals should be chosen who will complete the Form B 
(Employee) Questionnaires. In order that a random group will be chosen, we 
ask that you follow the procedure shown below. 



Step #1 


Starting with Number 1 for the first name on the list, 
number all remaining names consecutively. 


Step #2 


Divide your total number of employees by lour. This 

will give you a quotient, and a remainder in some instances. 


Step #3 


Use the remainder as a means of locating the first individual 
to be selected, i.e,, if the remainder is 3, count down to the 
third individual from the top of the list. 


Step #4 


Use the quotient to select the remaining three people, i.e., 
if the quotient is two, take every second person after the 
initial person has been selected according to Step #3# In 
this case you would continue selecting every second person 
until three have been identified. 

If you have four, or a lesser number on your staff, then all 
of them would be requested to complete the questionnaire. 


For 

Example : 


Example #1 

Staff size of 13 divided by four equals a quotient of 3, 
remainder of 1. 

With a remainder of 1, the first name on the list is 
chosen initially. With a quotient of 3, count down 
to the third name below the one already chosen, or 
name #4 on the list. Continue taking every third name 
until a total of four have been selected. 

Example #2 

Staff size of 6 divided by 4 equals a quotient of 1, 
remainder of 2, 

As the first step, select the second name on the list* 
Thereafter, take the next three consecutive names, 
since the quotient equals 1- 
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PLEASE USE THE LAST PAGE TO COMMENT ON Tm QUESTIONNAIRE 
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Comments on the Questionnaire 



Since this questionnaire is being tested before preparation in 
form for use throughout the country with educational R-D-D-E pe 
your comments on its content and format are as valuable as the 
you have made. Please comment as frankly as you desire. 



its final 

rsonnel, 

responses 



For each comment, 
make the approprio 
the meaning of act 
understand what I 



please reference the page and item 

te changes (@,g , page_ , item 

ivity # J or, page , 

was supposed to do » and so on. 



numbe r so 
, could 
item f 



that we can 
not understand 
’could not 
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SURVEY OP EDUCATION PERSONNEL IN RESEARCH, 
DEVELOPMENT, DIFFUSION AND EVALUATION ACTIVITIES 



To the Respondent: 

The attached Questionnaire B is under development in 
connection with a survey of the demand for Research 
Development, Diffusion and Evaluation personnel 
in Education, You have been identified by vour 
supervisor as one who engages in one or more of these 
activities* We are asking for your cooperation in 
filling out the questionnaire and in giving us any 
comments you may want to make concerning its format 
and wording and the general answerability of the 
questions with reference to your work activities 
and your education and experience* 

When you have completed the questionnaire and your 
comments, please return them to us in the attached 
stamped, self-addressed envelope. 

Your cooperation is greatly appreciated . 



enclosures 

questionnaire 
return envelope 

PLEASE FILL OUT THIS QUESTIONNAIRE AS SOON AS YOU RECEIVE 
IT AND RETURN IT TO US IMMEDIATELY UPON COMPLETION, 



Sincere iy , 




Carl II. Rittenhousc 

Senior Research Psychologist 
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Questionnaire B 



Project Code No. 

Name (opt ional) 

Please indicate the complete title of the project or activity on which you 
are currently working, 



Write your job title or position 

How long have you worked in present job? 

Number of years Number of months if less than one year 

How many people do you supervise in this capacity? 

Briefly describe what you do on this job. 



Sex 



Check the appropriate 



Male 

Female 



age category 



Under 25 
25 - 29 
30 - 34 
35 - 39 
40 - 44 



45 - 49 
50 - 54 
55 - 59 
60 - 64 
Over 64 



Actual Annual Salary 
Under $3,000 $18,000 - $20,999 



_$ 3,000 - $ 5,999 
_$ 6,000 = $ 8,999 
$ 9,000 - $11,999 
$12,000 - $14,999 
$15,000 - $17,999 



_$2 1,000 - $23,999 
$24,000 - $26,999 
_$27 , 000 - $29,999 
$30,000 or more 



If less than full time, indicate approximate 
fraction of full time that you work, 
e, g. , 1/4, 1/2, etc. 



Check the highest level of formal education you have obtained. 

High school with no college level course work 

High school and some college courses, but do not have 

a degree or certificate yet. Number of years completed 

Two years of college completed with a degree or certificate 

Bachelors degree 

Masters degree 

Doctorate or Post-doctoral degree 
Other professional degree, specify type 
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1, On the following pages is a list of activities that may bo performed by 
those working in educational research, development, diffusion and/or 
evaluation, W° understand that your current project work falls appropriately 
under one or more of those general descriptive headings. The more detailed 
list of activities or skills given below Includes some items that fall under 
each of the general headings, but for the purposes of this question, it is 
only important that you respond to each individual item in terms of your 
present activity without regard to its possible placement under one of the 
more general area descriptions. Some of the activities in which you engage 
on your present job may not be included in the list. In order to avoid 
putting an excessive burden of time and effort on any respondent in completing 
the questionnaire, a longer, comprehensive list was divided into several 
parts. You need concern yourself only with the items on this list. Other 
respondents will respond to other items so as to obtain complete coverage. 

Please respond to the activities in the following way: 

First, read the activity description, then in Section A , indicate the degree 
to which you are now involved in it by placing a check mark in the appro- 
priate column. 

In Section B, indicate how you acquired the skills involved in the activity 
i,a* t through formal training, or experience on the job, or through a com- 
bination of both. However, if you have not acquired the skills for the 
activity place a check mark in the first column of Section B and leave the 
remaining columns of Section B blank. 



In Section C, show the extent to which you feel a need for further training 
in skills associated with the activity, regardless of how you answered it 
in the preceding Section B, 



At the top of the table is an example of how a person might respond to the 
example item of "Developing measuring instruments This individual 
indicated "moderate Involvement" in the activity, felt that he had acquired 



the necessary skills mainly through 
"great need" for additional training 



’job experience and finally, saw a 
in the associated skills. 
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Section A 



R-D-D--E ACTIVITIES 



Example s Developing measuring instruments 



1 . Drawing research implications from 
results of prior research studies 

2 . Identifying and delineating 
significant researchable problems 

3 . Specifying data or evidence 
necessary for a rigorous test 
of an hypothesis 

4. Understanding experimental, quasi- 
experimental , and other systematic 
approaches to inquiry , and drawing 
on such knowledge in designing a 
research study appropriate to the 
problem under consideration 

5 * Selecting appropriate techniques 
of measurement 



Involvement in Activities 



Little 
or No 
Involve- 
ment 



Moderate 

Involve- 

ment 



Heavy 

Involve- 

ment 



Have Not 
Acquired 
Skills 



6, Organising data for analysis 

7, Interpreting and drawing appropriate 
conclusions and implications from 
data analyses 

8 , Reporting research findings and 
implications , orally and in writing 

9 , Specifying desired performance 
outcomes (objectives) of instruction 

10 . Devising techniques to identify 
entry capabilities of learners 

11. Describing a product to be developed 

12* Directing the work of materials 
production personnel 

13, Reporting evaluation of outcomes 



14. Selecting from all available 
information about developed product 
packages that which can be most 
effectively disseminated 

15, Selecting the moat effective 
dissemination vehicles to convey 
information to target groups 

O 
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Section B 



Section C 



How Skills Were Acquired 


Need for Additional Training 
in Associated Skills 


Have Not 
Acquired 
Skills 


Mostly 

Through 

Formal 

Education 

and 

Training 


Mostly 
Through 
Experience 
on the Job 


About 
Equally 
Through a 
Combinat ion 
of both 


Little 
or No 

Additional 

Need 


Moderate 

Need 


Great 
Need for 
Additional 
Training 






X 








X 







































































































































































































































O 




so 



Section A 

Involvement in Activities 



16 . 

17 , 
18 , 

19 . 
20 . 
21 . 

22 , 

23 , 

24 , 

25 , 

26 , 
27 , 



O 




Little 
or No 
Involve- 



Moderate 



Heavy 



Have Not 1 



Involve- 



Involve- 



Acquired 



R-D-D-E ACTIVITIES 



ment 



ment 



ment 



Skills 



1 



Implementing actual dissemination, 
including the direction of technical 
production personnel 



Selecting appropriate setting and 
personnel for a product demonstration 

Designing modifications of a product 
to fit the adopting organization or 
system, when necessary 



Identifying goals of an educational 
system 

Clarifying and explicating desired 
outcomes of an educational system 

Helping educational system personnel 
to develop objectives which, if 
attained, will solve the problems 
resulting from discrepancies between 
actual and intended system outcomes 

Identifying and rating alternative 
strategies for attaining the selected 
educational system objectives 

Identifying and rating available 
educational program resources (human, 
material, and financial) and/or 
potential sources of support 



Selecting a strategy for educational 
program implementation 

Writing proposals for research, 
development, dissemination and/or 
evaluation projects 



Providing immediate feedback to 
educational program operators for 
their possible use in making decisions 
about modifications of plans, 
procedures , or resource allocations 

Developing general criteria and 
designing data collection procedures 
for application in measuring the 
effectiveness and efficiency of 
existing innovative practices and 
products , i,©, , minimum standards 
and outcomes which indicate successful 
utilization of practices and prodq^t^ 



Section C 



Section B 


Need f< 


3T Additional Training 
Associated Skills 




How Skil 


Is Were Acquired 


in i 


Have Not 
Acquired 
Skills 


Mostly 

Through 

Formal 

Education 

and 

Training 


Mostly 
Through 
Experience 
on the Job 


About 
Equally 
Through a 
Combination 
of Both 


Little 
or No 

Additional 

Need 


Moderate 

Need 


Great 
Need fo 
Additional 
Training 
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Section A 



R-D-D-E ACTIVITIES 


Involvement in Activities 


Hoi 


Little 
or No 
Involve- 
ment 


Moderate 

Involve- 

ment 


Heavy 

Involve- 

ment 


Have Not 
Acquired 
Skills 


Mo. 

Th: 

FO; 

Edui 

Tra: 














28* Identifying situations in which 

designated behavior can be observed 
and recorded 

29, Selecting (or developing) and using 
techniques of measurement to yield 
information relevant to standards to 
be used 

30, Selecting an appropriate technique 
to analyze data 

31, Deciding what recommendations to 
make as a result of outcomes 






















































rs 

< y 
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Section C 



Section B 


Need for Additional Training 
in Associated Skills 


How Skills Were Acquired 


Have Not 
Acquired 
Skills 


Mostly 

Through 

Formal 

Education 

and 

Training 


Mostly 
Through 
Experience 
on the Job 


About 
Equally 
Through a 
Combination 
of Both 


Little 
or No 

Additional 

Need 


Moderate 

Need 


Great 
Need for 
Additional 
Training 
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A number of educational areas are listed below. For each of the areas, please 
indicate the approximate amount of formal course work, graduate or undergraduate, 
you have completed by placing a checkmark in the appropriate column. If you 
have had no course work in the area, place the checkmark in the ’none 0 column. 



Educational Areas 



1. 

2 , 

3 , 

4, 

5, 

6 , 

7, 

a, 

9, 

10 , 

11 . 

12 . 

13, 

14, 

15 , 

16 , 

17 . 

18, 

19, 

20 , 
21 , 
22 . 



Statistics 
Learning theory 
Social Fsy e ho logy 
Audio-Visual Education 
Market ing 
Sociology 
Research design 
Testing and measurement 
Systems theory 
Adve rt ising 

Educational administration 
Political science 
Philosophy of science 
Data processing 
Theories of teaching 
Curriculum development 
Communication theory 
Decision theory 
Information theory 
Journalism 
Ant hropo logy 
Other (specify) 



rses 



1 

None j Few 


So v era 1 


i M ! 

Many ! 


(0) i (1 or 2) 


(3 to 5) 


1 (6 or more) j 


[ 

i 

; j 

i 


— 


' " i 

j ] 

: ■ 

1 

i i 

1 
1 

i 


[ __ 1 

: | 

1 j 

i z 




I f 

i 

j 



Circle the three areas from those listed that are most important for your current 
work, whether or not you have had course work in those areas 



3. Since you have boon employed in this field how much o f the following kinds of 

training relevant, to educational research, development, diffusion, or evaluation 
have you had? Indicate by placing a chock mark in the appropriate column after 
each kind of training 



Type of Training 



Am oun t of Training 





None 


Ve ry little 


Moderate 


Extensive 


Special supervised on the 
job training or internship 










In-service courses 










Ot he r ( s pe e i fy ) 

- OJ 
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4. Below is a list of types of employers. 

I n Section A t indicate the number of years you have been employed by 
each of the types of employers. If none, write "n one in the space. 

In Section B, indicate the relevance of each type of previous employ- 
ment to your present job by placing a checkmark in the appropriate column. 

If you have no previous experience put a check mark here , and go to the 

next item. 



Previous Employers 
College or university 

Educational R-D-D-E organisations 
Government 

Business and/or industry 

Other (specify 



Section A 


Section B 

Re levance 
to present job 


Number 
of years 


j 

Low 


! " 

Moderate 

i j 


High 




1 

| 








! 

1 


i 

i : 






i 

l 






! ■ — 
i 






1 

) 





5, Indicate any skills you have in educational or R-D-D^E areas that you 
do not use in your present job, 



6, To what extent are you satis lied with your present job? Place a checkmark 
below in the appropriate category. 



Completely Completely 

Satisfied Satisfied Undecided Dissatisfied Dissatisfied 
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7. To what extent are there advancement possibilities in your present job? 



Place a checkmark below the appropriate category. 

Highly Highly 

Probable Probable Unknown Improbable Improbable 

S, Below is a list of types of training or training materials. Indicate the 



value you place upon each type either to meet current job requirements or 
advancement plans by placing a checkmark in the appropriate column after 
each type. 

Types of additional Little 



training 


, or no 


Some 


Great 


A. 


Programmed instruction materials 
for your own use 


value 


value 


va lue 


B. 


Three to five day institutes 








C, 


Longer institutes 








B. 


One or two week university 
short courses 








E * 


Correspondence courses 








F. 


Extension courses 








G, 


Other (specify) 






j 



9- How important do you feel it is to receive college credit for any additional 
training you might obtain? Indicate by placing a checkmark below the appro- 
priate category. 

Ext re me ly Comp lately 

Important Important Undecided Unimportant Unimportant 



If you checked "important " or "extremely important " , please give your reasons 




PLEASE USE THE NEXT PAGE TO COMMENT ON THE QUESTIONNAIRE, 
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Comme nt.s on the Quest ion na ire 



Since this questionnaire is being tested before preparation in its final 
form for use throughout the country with educational R=“D-D--E personnel, 
your comments on its content and format are as valuable as the responses 
you have made. Please comment as frankly as you desire. 



For each comment, please reference the page and Item numbe r so 

make the appropriate changes (e.g,, page , itern^ , could 

the meaning of activity # ; or, page > item , 

understand what I was supposed to do", and so on. 



that we can 
not understand 
"could not 




SURVEY OF EDUCATION PERSONNEL IN RESEARCH, 
DEVELOPMENT, DIFFUSION AND EVALUATION ACTIVITIES 



To L he Ro s p o n d ent : 

The attached Ques t ioimai re B is under development in 
connection with a survey of the demand for Research 
Development, Diffusion and Evaluation personnel 
in Education. You have been identified by your 
supervisor as one who engages in one or more of these 
activities. We are asking for your cooperation in 
filling out the questionnaire and in giving us any 
comments you may want to make concerning its format 
and wording and the general answerability of the 
questions with reference to your work activities 
and your education and experience. 

When you have completed the questionnaire and your 
comments } please return them to us in the attached 
stamped, self-addressed envelope. 

Your cooperation is greatly appreciated. 



PLEASE FILL OUT THIS QUESTIONNAIRE AS SOON AS YOU RECEIVE 
IT AND RETURN IT TO US IMMEDIATELY UPON COMPIETXON 



Sincere ly , 




Carl H, Rit ten house 

Senior Research Psychologist 



cnc Insures 

questionnaire 
return e nve 1 ope 
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Quest ionnai re 0 

Project Co* Jo N« » , 

Name < oj> L i oiui 1 ) 

Flea.se i nd it:u t.c* the complete tit.ii/ ot the? pro jeci or activity on which vcjii 
arc currently working. 



Write your job title or position 

How long have you worked in pro Bent job? 

Number of years Numbo r ol months if less than one year 

How many people do you supervise* in this capacity? 

Briefly describe what you do on this job. 



Sex 



Ma le 



Fe m a 1 e 



Check the appropriate Actual Annual Salary 

age category 



Under 20 


45 =49 


Unde r $3 , 000 




$18,000 


- $20,999 


25 - 


29 


50 - 54 


$ 


3,000 - 3 


5,999 


$21, 000 


- $23,999 


30 - 


34 


55 = 59 


$ 


6 , 000 - $ 


8, 999 


$24 , 000 


- $26, 999 


35 - 


30 


60 - 64 


$ 


9,000 = $ 


11 , 999 


$27,000 


- $29,999 


40 - 


44 


Ove r 64 


$ 


12,000 - $ 


14,999 


$30,000 


or more 








$ 


15,000 ~ $ 


17,999 







If less than full time, indicate approximate 



.traction of full time that you work, e.g, , 
1/4, 1/2, 



Cheek the highest level of formal education you have obtained. 

High school with no college level course work 

_ High school and some college courses, but do not have 

a degree or certificate yet. Number of years completed 

Tw 0 years of college completed with a degree or certificate 

Bachelors degree 



Masters degree 

Doctorate or Post -doctoral degree 
Other professional degree, specify type 







1. On the following pages is a list of activities that may be performed by 
those working in educational research, development, diffusion and/oi 
evaluation- We understand that your current project work falls appropriately 
under one or more of those general descriptive headings. The more detailed 
list of activities or skills given below includes some items that fall under 
each of the general headings, but for the purposes of this question, it is 
only important that you respond to each individual item in terms of your 
n re sent, activity without regard to its possible placement under one of the 
more general area descriptions. Some of the activities in which you engage 
on your present .job may not bo included in the list. In order to avoid 
putting an excessive burden of time and effort on any respondent in completing 
the questionnaire, a longer, comprehensive list was divided into several 
Dart s You need concern yourself only with the items on this list. Other 
respondents will respond to other items so as to obtain complete coverage. 

Please respond to the activities in the following way: 

First read the activity description, then in Section A , indicate the degree 
to which you are now involved in it by placing a check mark In the appro- 
priate column. 

In Section B, indicate how you acquired the skills involved in the activity 
i e” through formal training, or experience on the job, or through a com- 

bination of both. However, if you have not acquired the skills for the 
activity place a check mark In the first column of Section B and leave the 
remaining columns of Section B blank. 

In Section C, show the extent to which you feel a need for further training 
in skills as soc i a tod with the activity, regardless of how you answered it 
in the preceding Secition B, 

At the top of the table is an example of how a person might respond to the 
example item of "Developing measuring instruments." This individual 
indicated "moderate involvement" in the activity, felt that he had acquired 
the necessary skills mainly through "job experience and finally, saw a 
"great need" for additional training in the associated skills. 



o 

ERIC 
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Section A 







Involvement in Activities 


I - 




R-D-D-E ACTIVITIES 


Little 
or No 
Involve- 
ment 


Moderate 

Involve- 

ment 


Heavy 
Involve - 
ment 


Have Not 
Acquired 
Skills 


h 

1 

I 

Ed 

Ti 


Example: Developing measuring instruments 




X 








1. 


Identifying and delineating significant 
re searchable problems 












2. 


Procuring and/or managing resources 
(material and human) necessary to 
reach research objectives 












3, 


Identifying a population to which 
results should be generalized and a 
sample representative of that population, 
using appropriate sampling techniques 
to draw the sample 












4. 


Applying a research design, recognizing, 
explicating and controlling threats 
to validity 












5, 


Developing measuring instruments 












6. 


Understanding the general role, 
types, and assumptions underlying 
various statistical techniques, and 
drawing on such knowledge in 
selecting and using appropriate 
techniques of data analysis 












7. 


Interpreting and drawing appropriate 
conclusions and Implications from 
data analyses 












8. 


Interpreting information concerning 
education goals 












9. 


Specifying desired performance 
outcomes (objectives) of instruction 












10. 


Identifying alternative instructional 
and media techniques 












11. 


Describing a product to be developed 












12. 


Selecting or devising appropriate 
techniques for measuring outcomes 












13, 


Interpreting evaluation findings 












14, 


Selecting the most effective dissemination 
vehicles, to convey information to 
target groups 
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j How Skills Were Acquired 


bection C 

Need for Additional Training 
in Associated Skills 


/ 

rs- 


Have Not 
Acquired 
I Skills 


Mostly 

Through 

Formal 

Education 

and 

Training 


Mostly 
Through 
Experience 
on the Job 


About 
Equally 
Through a 
Combination 
of both 


Little 
or No 

Additional 

Need 


Moderate 

Need 


Great 
Need for 
Additional 
Training 








X 








X 




































































































































— — 
























— 
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Section A 



R-B-D-E ACTIVITIES 



Composing the information, within a 
chosen format, for accurate and 
pervasive dissemination 

Implementing actual dissemination, 
including the direction of technical 
production personnel 

Managing and coordinating a product 
demonstration effort 

Designing procedures for modifying 
the adopting system or organisation 
to fit a product, when necessary, 
including the design of needed 
training programs 

Assessing the social relevance of the 
goals of an educational system 

Measuring current actual outcomes of 
an educational system through 
techniques such as: 

a. demographic analysis 

b. economic analysis 

c . psychometric analysis 

d. systems analysis 

e . observational techniques 

Designing a monitoring system that will 
provide continual data on the status 
of an operating educational system 

Identifying and rating alternative 
strategies for attaining the 
selected educational 
system objectives 

Identifying and rating available 
educational program resources (human, 
material, and financial) and/or 
potential sources of support 

Selecting a source of support or the 
available resources which will be 
used to implement an educational 
program 




Involvement in Activities 



Little 
or No 
Involve- 
ment 



Moderate 

Involve- 

ment 



Heavy 

Involve- 

ment 



Have Not 
Acquired 
Skills 



V' ; ■ X'% Vrjwvv? r - ■ ^ 



"‘.-'•V 'r'-',;?. - ■? ’.YT-s -; 
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Section A 



R-D-D-E ACTIVITIES 



25, Designing and selecting indicators of 
progress in educational programs 

26, Perceiving human relation problems that 
threaten the success of 
educational programs 



Involvement in Activities 



Little 
or No 
Involve- 
ment 



Mode rate 
Involve- 
ment 



Heavy 

Involve- 

ment 



Have Not 
Acquired 
Skills 



27. Developing general criteria and designing 
data collection procedures for appli- 
cation in measuring the effectiveness 
and efficiency of existing innovative 
practices and products * i.e.* 

minimum standards and outcomes which 
indicate successful utilization of 
practices and products 

28. Establishing standards or norms for 
judging whether objectives have 
been attained 

29. Selecting (or developing) and using 
techniques of measurement to yield 
information relevant to standards 
to be used 

30. Analyzing the evidence yielded by 
un evaluation 

31. Estimating the potential impact of 
outcomes on the problem area 
being served 





Section B Section C 



How Skills Were Acquired 


Need for Additional Training 
in Associated Skills 


Have Not 
Acquired 
Skills 


Mostly 

Through 

Formal 

Education 

and 

Training 


Mostly 
Through 
Experience 
on the Job 


About 
Equally 
Through a 
Combination 
of both 


Little 
or No 
Additional 
Need 


Mode rate 
Need 


Great 
Need for 
Additional 
Training 
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A number oi' oduca l ioiw 1 areas a re listed below. For each o 1' the areas, please 
indicate the upproxi nui i e amuuni of formal course work, gradual c or undergraduate- 
you have completed by placing a checkmark in the appropriate column, If you 
have had no course work in the area, place the checkmark in the none column. 



Educational Arens 



1. 

2 , 
3 , 
■1. 



6 . 

7. 

8 . 

9 . 
10 , 
11 . 
12 , 

13. 

14. 

15. 

16. 

17. 

18 . 

19. 

20 . 
21 , 
22 . 



N u rn bo r o I, C u u r s o s 



None 

( 0 ) 



Few 

(1 or 2) 



So ve r a 1 
(3 to 5) 



Many 
(6 or mo re ) 



I 



! 



»S t a 1 1 S t i c s 
Learning theory 
Social Ps y c ho 1 ogy 
Audio-Visual Educut ion 
Ma rko ling 
Sociology 
Research design 
Testing 1 and measurement 
Systems theory 
Adve rtising 

Educat io na 1 ad mi n is t ra t ion 
Political science 
Philosophy of science 
D a t a p roce s s 1 ng 
Theories o f touching: 

Curriculum dove iopment 
Communication t heory 
Decision theory 
Information theory 
Jou rna 1 ism 
An t h rape? logy 
Dt he r (speci f v.l 

Circle the three areas from those listed that are most important for your current 
work* whether or not you have had course work in those areas 



t 



3. 




Since you have been employed in this field how much o f- o 1 1 ow i ng kinds of 
training relevant to educational research, development, diffusion, or evaluation 
have you had? Indicate by placing a check mark in the appropriate column after 
each kind of training 



Type of Training Amount of Training 





None 


Very little 


Moderate 


Extensive 


Special supervised on the 
Job training or internship 










I n -s e r v i eo eo u r s i-j s 










Other (specify) 

” ~ ‘ i 


!08- 







... . . 
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4. Below is a list of types of employers, 

In Section A , indicate the number of years you have been employed by 
each of the types of employers. If none, write "none" in the space. 

In Section B , indicate the relevance of each type of previous employ- 
ment to your present Job by placing a checkmark in the appropriate column. 

If you have no previous experience put a check mark here ? and go to the 

next item. 



Previous Employers 

College or university 
Educational R^B^D-E organizations 
Gove rnmen t 

Business and/or industry 
Other (specify 



Section B 
Re lcvance 



j Section A 


to present job 


j Number 

; of years 


i 

' 

Low | Moderate 


? 

Hi S h 


i 






1 


i 


1 

! 




i 


i 




------ — i 

j 


i 




L. ...... 


j 



5, Indicate any skills you have in educational or R-B-D^E areas that you 
do not use in your present job* 



6. To what extent are you satisfied with your present job? Place a checkmark 
below in the appropriate category „ 




Comp le te ly 
Satisfied 



Satisfied 



Undecided 



Dissatisfied 



Complete ly 
Dissat is fled 



-a- 



7. To what extent are there advancement pos.sl bi 1 i t ie-s in your present job? 
Place a checkmark below the appropriate category. 



Highly 

Probable 



Highly 

Probable* Unknown Improbable Improbable 



8. Below is a list of types of training or training materials. Indicate the 
value you place upon each type either to meet current job requirements or 
advancement plans by placing a checkmark in the appropriate column after 
each type. 



Types of additional 
training 

j 


Li tt le 
or no 
; va Lue 


Some 

value 


Great 
yn lue 


A, Programmed instruction materials 
Cor your own use 

B. Three to five day institutes 

C. Longer institutes 

D, One or two week university 


i ' " 

i 
















i 








short courses 

E, Correspondence courses 

F, Extension courses 

G, Other (specify) 






i 

. .... i 






i 

1 






i 

[ 

i 
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How important do you feel it is to receive college credit for any additional 
training you might obtain? Indicate by placing a checkmark below the appro- 
p ri a t e cate go ry * 



Extreme ly 

Important Important 



Comp let© ly 

Undecided Unimportant Unimportant 



If you checked 



"important" or "extremely important , 



please give your reasons 




PLEASE USE Tlffi NEXT PAGE TO COMMENT ON THE QUESTIONNAIRE. 



110 



-9 



Co limit* n t s on the Questionnaire 



Since this questionnaire is being tested be lore preparation in 
i orm for use throughout i lie country with educat ional H s D-D~E po 
you r coming n t s on its content and formal are as valuable as t he 
you have made* Please comment as t rankly us you ciusite. 



its final 
rsonne 1 , 

responses 



For each comment, please re l e fence 
make the appropriate changes <e,g* 

the meaning of activity & 

understand what I was supposed to 



the page and item number so 

— — s — . — n 

, page , item could 

; or, page » item , 

do ? ', and so on. 



that we can 
not understand 
could not 
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SURVEY OF EDUCATION PERSONNEL IN RESEARCH, 

DE VE LO PME NT , DIFFUSION AND EVALUATION ACTIVITIES 



To the Respondent : 

The attached Olios t ion na i re R is under development in 
connection with a survey of the demand for Research 
Development, Mi f fusion and Evaluation pcitswrinel 
in Education, You have been identified by you r 
supervisor as one who engages in one or more of these 
activities r We arc asking for your cooperation in 
filling out the questionnaire and in giving us any 
comments you may want to make concerning its format 
and wording and the general answerability of the 
questions with reference to your work activities 
and your education and experience. 

When you have completed the questionnaire and your 
comments, please return them to us in the attached 
stamped, self-addressed envelope. 

Your cooperation is greatly appreciated. 



Since re ly 




Carl H. Ri t tollhouse 

Senior Research Psychologist 



one losures 

quos t iunna i ru 
return envelope 



PLEASE FILL OUT THIS QUESTIONNAIRE AS SOON AS YOU RECEIVE 
IT AND RETURN IT TO US IMMEDIATELY UPON COMPLETION, 



= 1 - 



Quest ionnni rg B 

Project Code No, 

Ni* mo (optional ) 

Please indicate* the* complete title of the project or activity on which you 
are currently working, 



Write your job title or position i 

How long have you worked in present job? 

Number of yea rs Number of months it less than one year 

How many people do you supervise in this capacity'? 

Briefly describe what you do on this job. 



Sex Check the appropriate Actual Annual Salary 



_Ma le 


age category 
Under 20 


45 - 49 


Under $3,000 






$18,000 


- $20,999 


Fema le 


25-29 ~ 


“50 - 54 


$ 


3,000 - $ 


5, 


999 


$ 21,000 


“ $23,999 




__ 30 - 34 ” 


J35 - 59 


$ 


6,000 - $ 


s, 


999 


$24,000 


“ $26,999 




35-39 ~ 


60 “ 64 


$ 


9,000 - $ 


U, 


999 


$27,000 


- $29,999 




___ 40 44 ~ 


Over 64 


$ 


12,000 - $ 


14, 


999 


$30,000 


or more 








" $ 


15, 000 - $ 


17, 


999 







If lens than full time* indicate approximate 
fraction of full time that you work, e , g ( , 
1/4, 1/2, 

Check the highest level of formal education you have obtained. 

High school with no college level course work 

__ High school and some college courses, but do not have 

a degree or certificate yet. Number of years completed 

Two years of college completed with a degree or certificate 

__ Bachelors degree 

Masters degree 

Doc t orate or Po s t -d oc to ra 1 deg ree 

Other p ro f e s s 1 on a 1 do g ree , s pe c i f y t y pc 



o 
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1, On the following pages is a list of activities that may be performed by 
those working in educational research, development, diffusion and/or 
evaluation We understand that your current project work falls appropriately 
under one or more of those general descriptive headings. The more detailed 
list of activities or skills given below includes some items that fall under 
each of the general headings, but for the purposes of this question, it is 
only important that von respond to each individual item in terms of your 
present activity without regard to its possible placement under one of the 
more general area descriptions. Some of the activities in which you engage 
on your present job may not be included in the list. In order to avoid 
putting an excessive burden of time and effort on any respondent in completin 
the questionnaire, a longer, comprehensive list was divided into several 
parts. You need concern yourself only with the items on this list. Other 
respondents will respond to other items so as to obtain complete coverage. 



Please respond 



to the activities in the following way: 



First, read the activity description, then in Sou lion A , indicate the decree 
to which sou are now involved in it by placing a check mark in '.lie appro- 
priato colu mn , 



In Section B, indicate how you 
i . e~ through formal training, 
bination of both* However, If 
activity place a check mark in 
remaining columns of Section B 



acquired the skills involved in the activity 
or experience on the job, or through a com- 
you have not acquired the skills for the 
the first column of Section B and leave the 
blank * 



In Section C, show the extent to which you feel a need for lurther training 
in skills associated with the activity, regardless of how you answered it 
in the preceding Section B . 



At the top of the table is an example of how a person might respond to the 
example item of "Developing measuring instruments." This individual 
indicated "moderate involvement" in the activity , felt that he had acquired 
the necessary skills mainly through "job experience" and finally , saw a 
"great need" for additional training in the associated skills. 







Section A 







Involvement in Activities 






R-D-D-E ACTIVITIES 


Little 
or No 
Involve - 
me nt 


Moderate 

Involve- 

ment 


Heavy 

Involve- 

ment 


Have Not 
Acquired 
Skills 


Example: Developing measuring instruments 


X 








1 # 


Identifying and delineating signi- 
ficant researchable problems 










2 , 


Interpreting, evaluating, and synthe- 
sizing relevant literature 










3, 


Formulating alternative generaliza^ 
tions from predicted research outcomes 










4, 


Identifying classes of behavioral 
outcomes for measurement 










5. 


Assessing the validity of outcome 
measures 










6 . 


Using aids in data analyses, such as 
computer processing 










7. 


Interpreting and drawing appropriate 
conclusions and implications from 
data analyses 










8, 


Drawing on research results in plan- 
ning developmental activities 










9. 


Specifying desired performance out- 
comes (objectives) of instruction 










• 

O 

i—i 


Determining appropriate sequences 
of topics in instruction 










11. 


Describing a product to be developed 










12. 


Designing and managing initial labora- 
tory tests of developed techniques 
and materials 










13. 


Specifying requirements for product 
dissemination vehicles to convey 
information to target groups 












y? ^ (MV 



Section B 



Section C 





How Skills Were Acquired 


Need for Additional Training 
in Associated Skills 




Have Not 
Acquired 
Skills 


j Mostly 
1 Through 
Formal 
Education 
and 

Training 


Mostly 
Through 
Experience 
on the Job 


About 
Equally 
Through a 
Combination 
of Both 


Little 
or No 
Additional 
Need 


Moderate 

Need 


Great 
Need for 
Additional 

Training 








X 








X 





























































































































































































Section A 



R-D-D-E ACTIVITIES 

14* Selecting the most effective dis- 
semination vehicles to convey 
information to target groups 

15, Implementing actual dissemination, 
including the direction of tech- 
nical production personnel 

16, Designing and implementing tech- 
niques for evaluating the effective- 
ness of a dissemination effort 

17, Evaluating the effectiveness of a 
product demonstration 

18, Identifying potential barriers to 
implementation after product adoption 

19, Identifying values that are implicit 
in educational system goals 

20, Comparing actual and intended edu- 
cational system outcomes to identify 
discrepancies (needs) which exist in 
the system 

21, Helping educational system personnel 
to apply criteria to lists of possible 
objectives in order to select those 
which are feasible within constraints 
of an operating context 

22, Identifying and rating alternative 
strategies for attaining the selected 
educational system objectives 

23, Identifying and rating available edu- 
cational program resources (human, 
material, and financial) and/or poten- 
tial sources of support 

24, Predicting the potential barriers to 
success in a proposed course of edu- 
cational program implementation action 
and judging the potential of the 
strategy for overcoming the estimated 
procedural barriers 

o 




Involvement in Activities 




Moderate 

Involve- 

ment 



Heavy 
Involve - 
ment 




Have Not 
Acquired 
Skills 



ii’? 



Section B 



Section C 



How Skills Were Acquired 


Need for Additional Training 
in Associated Skills 


ave Not 
cquired 
Skills 


Mostly 

Through 

Formal 

Education 

and 

Training 


Mostly 
Through 
Experience 
on the Job 


About 
Equally 
Through a 
Combination 
of Both 


Litt le 
or No 

Additional 

Need 


Moderate 

Need 


Great 
Need for 
Additional 

Training 




























































































































































o 




■ — ™ 


— ' 
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Section A 





Involvement in Activities 




R-D-D-E ACTIVITIES 


Little 
or No 
Involve- 
ment 


Mode rate 
Involve - 
ment 


Heavy 

Involve- 

ment 


Have Not 
Acquired 
Skills 




Monitoring educational programs to 
detect deviations from design or 
specified procedures through tech- 
niques such as unobtrusive measures, 
systems analysis, and observational 
techniques 












Applying appropriate designs to edu- 
cational evaluation studies 












Developing general criteria and design- 
ing data collection procedures for 
application in measuring the effective- 
ness and efficiency of existing innova- 
tive practices and products, i . e , , 
minimum standards and outcomes which 
indicate successful utilisation of 
practices and produces 












Selecting (or developing) and using 
techniques of measurement to yield 
information relevant to standards to 
be used 












Assessing the validity of outcome 
measu res 












Judging the strengths and weaknesses 
of the plans and procedures employed 
for meeting project objectives 












Providing sufficient information to 
the decision-maker to enable him to 
decide whether to continue, modify, 
or terminate an activity or process 
evaluated 













Section B 



Section C 



How Skills Were Acquired 


Need for Additional Training 
in Associated Skills 


Have Not 
Acquired 
Skills 


Mostly 

Through 

Formal 

Education 

and 

Training 


Mostly 
Through 
Experience 
on the Job 


About 
Equally 
Through a 
Combination 
of Both 


Little 

or No 

Additional 

Need 


Moderate 

Need 


Great 
Need for 
Additional 
Training 






































































































S2Q 



"6" 



2 . 



A number' of educational areas are listed below. For each ol‘ the areas, please 
indicate the approximate amount of formal course work, graduate or undergraduate^ 
you have completed by placing a checkmark in the appropriate column* If you 
have had no course work in the area, place the checkmark in the none column. 

Ed ucation a 1 A re a s Nu m be r o f Cou rses 

r ■ i 1 



j None I Few j Several ( Many 

(0) 1 (1 or 2) (2 to 5 ) j ( 6 o r mo re ) 



] . Statistics 

2. Learning theory 

3, Social Psychology 

•1 . Aiicl i o - Vi s u a 1 Edu call o n 
5, Marketing 
6 . Sociology 

7, Research design 

8, Testing and measurement 

9, Systems theory 

10. Advertising 

11. Educational administration 
12* Political science 

13. Philosophy of science 
1-1. Oat a processing 

15. Theories of teaching 

16, Curriculum development 

17, Communication theory 

18. Decision theory 




19. Information theory 
2 0 . Jgu rn alls m 

21, Anthropology 

22, O t he r (sp ed f y ) 



Circle the three areas from those* Listed that are most; important for your current 
work, whether or not you have* had course work in those areas 



3. Since* you have been employed in this fluid how much ol' the following kinds of 

training relevant to educational research, development, diffusion, or evaluation 
have you had? Indicate by placing a chock mark in the appropriate column after 



each 




kind of training 



Type of .Training Amount of Training 





None 


Very little 


Mode r a te 


Ex tons i ve 


Special supervised on t lie 
Job training or internship 










In -se i v ice? cou rses 










Ot he* r ( s pe c i C v ) 

— 1 


s?i • - 
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4, Bo low in a list of typos of employers. 

In Section A , indicate the number of years you have been employed by 
each of the types of employers. If none, write "none in the space. 

In Section B, indicate the relevance of each type of previous employ- 
ment to your present .job by placing a checkmark in the appropriate column. 

If you have no previous experience put a check mark here , and go to the 

next item. 



Section B 



Previous Employers 
Co n lege or university 

Educational R-D-D-E organizations 
Gove rnment 

Business and/or industry 
Other (specify 



Re levancc 




5, Indicate any skills you have in educational or R-=D-D^E areas that you 
do not Lise in your present job. ^ 



6 , To what extent are you sat is fled with your present job? Place a checkmark 

below in the appropriate category. 



Undecided 



Complete ly 
Dissatisfied 



o 

ERLC 



Completely 

Satisfied 



Satisfied 



Dissatisfied 






7. To what extent are there advancement pas si bi titles in your present job? 

Place a checkmark below the appropriate category. 

Highly Highly 

Probable Probable Unknown Improbable Improbable 



8. Below is a list of types of training or training materials. Indicate the 
value you place upon each type either to meet current job requirements or 
advancement plans by placing a checkmark in the appropriate column aftei 
each type. 



Types of additional Little 

training Qr ho 

j va lue 


Some 

value 


Great 
va lue 


< 

A, Programmed instruction materials J 

for vour own use ! 






B. Three to five day institutes 






r. Longer institutes ■ 1 






f 

D, One or two week university 
short courses 






Fh Correspondence courses 




i 


F. Extension courses 




i 

, i 


G. Other (specify) 




f 

1 

! 



How important do you feel it is to receive college credit for any additional 
training you might obtain? Indicate by placing a checkmark below the appro- 
priate category. 

Extremely Completely 
Important Important Uncle c ided Unimportant Unimportant 



If you checked "important" or "extremely important , please give your reasons 




PLEASE USE TICE NEXT PAGE TO COMMENT ON THE QUESTIONNAIRE, 



Comments on the Questionnaire 



Since this questionnaire is being tested be lore preparation in its final 
form for use throughout the country with educational personnel, 

you i* comments on its content and format arc as valuable as the responses 
you have made. Please comment as l rankly us you desire* 



For each comment, please reference the page and item 

make the appropriate changes (e,g*, page , item 

the moaning of activity # * ° r > page , 

understand what I was supposed to do”, and so on* 



n urn be r so 
, could 
item , 



that we can 
not understand 
"could not 



o 
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SURVEY OF EDUCATION PERSONNEL IN RESEARCH, 
DEVELOPMENT, DIFFUSION AND EVALUATION ACTIVITIES 



To t he Re s ponde n i : 

The attached Questionnaire B is under development in 
connection with a survey of the demand for Research 
Development , 104 1 L'usion and Evaluation pei\si'*mu? 1 

in Education, You have been identified by your 
supervisor as one who engages in one or more of these 
activities. We a ro a s k i n g to r y on r c cope r a t i o n in 
Filling out the questionnaire and in giving us any 
comments you may want to make concerning its format 
and wording and the general answerability of the 
questions with reference to your work activities 
and your education and experience. 

When you have completed the questionnaire and your 
comments, please return them to us in the attached 
stamped, soil-addressed envelope. 

Your cooperation is greatly appreciated. 



Sincere ly , 




Carl H, Rit ten house 

Senior Rosea rch Psychologist 



o nr losu res 

ques liunnai re 
return envelope 



PLEASE FILL OUT THIS QUESTIONNAIRE AS SOON AS YOU RECEIVE 
IT AND RETURN IT TO US IMMEDIATELY UPON COMPLETION, 



Filmed from best available copy 






-1 - 



Questionnaire B 



Project Code No. 

Name (op t ionii 1 ) 

Please indicate the complete title of the project or activity on which you 
nro currently working . 



Write your job title or posit ion_ 

How long have you worked in present job? 

Number o 1 years Number o I months if less than one year 

How many people do you supervise in this c a p a c i 1 y V 

Briefly describe what you do on this job. 



Sex Check the appropriate Actual Annual Salary 



Mil le 


age category 
Under 20 45 - *19 




Unde r $3 , 


000 




$18,000 - $20,999 


Ft; in a le 


25 -29 do - 54 




$ 3,000 


- 3 


5,999 


_ $21 , 000 - $23,999 




30 - 34 55 - 59 




$ 6,000 


- $ 


8,999 


$24,000 - $26,999 




35-39 00 - 64 




$ 9,000 


- 3 


11 , 999 


$27,000 - $29,999 




40-44 over 64 




$ 12 , 000 


- $ 


14 , 999 


$ 30,000 or more 








$ 15,000 


- 3 


17, 999 








If 


Igms than 


fu 1 1 t ime , 


indicate apjjroximate 



fraction of full time that you work, 
1/4, 1/2, 



Cheek the highest level of formal education you have* obtained. 

High school with no college Level course work 

High school and some col lege courses, but do not have 

a degree or cert i I irate yet. Number of years completed 

Two years of college completed with a degree or certificate 

_ Bachelors degree 

^ Masters degree 

Doc t ora to o r Po s t -cl oc t o ra 1 deg roe 
Other professional degree, specify typo 
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On the following pages Is a list of activities that may be performed by 
those working in educational research, development, diffusion and/or 
evaluation. We understand that your current project work falls appropriately 
under one or more of those general descriptive headings. The more detailed 
list of activities or skills given below includes some items that fall under 
each of the general headings, but for the purposes of this question, it is 
only important that you respond to each individual item in terms of your 
present activity without regard to its possible placement under one of the 
more general area descriptions. Some of the activities in which you engage 
on your present job may not be included in the list. In order to avoid 
putting an excessive burden of time and effort on any respondent in completing 
the questionnaire, a longer, comprehensive list was divided into several 
parts You nuutl concern yourself only with the items on this list. Other 
respondents will respond to other items so as to obtain complete coverage. 



Please respond to the activities in the following way. 



First, read the activity description, then in Section A , indicate the degree 
to which you are now involved in it by placing a check mark in the appro- 
priate eolu mn , 



In Section 13 , indicate how you 
i t e M through formal training, 
bination of both. However, if 
activity place a check mark in 
remaining columns of Section B 



acquired the skills involved in the activity 
or experience on the job, or through a com- 
you have not acquired the skills for the 
the first column of Section B and leave the 
blank. 



In 
in 
i n 



Section C, show the extent to which you feel a 
skills associated with the activity, regardless 
the preceding Section B, 



need for further train! 
of how you answered it 



ng 



At the top of the table is an example of how a person might respond to the 
example item of "Developing measuring i ns tmiments . " This individual 
indicated "moderate involvement" in the activity, felt that he had acquired 



the necessary skills mainly 
"great need" for additional 



through "job experience” and finally, saw a 
training in the associated skills. 
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Section A 



Involvement in Activities 



Hov 

Mob 

Thi 



Little 



Foi 



R-D-B-E ACTIVITIES 
Example : Developing measuring 



1. Identifying and delineating 
eant researchable problems 



instruments 



signif i- 



or No 
Involve- 
ment 



Moderate 
Involve - 
ment 

X 



Heavy 

Involve 

ment 



Have Not 
Acqui red 
Skills 



Educ 

s 

Tral 



2* Formulating hypotheses or empirical 
questions to be answered by a study 

3, Identifying appropriate research 
methods 

4, Choosing specific research variables 
and treatments (where appropriate) 
to be used 

5, Using a variety of data-gathering 
methods (tests, interviews, analysis 
of documents, etc*) 

6* Interpreting and drawing appropriate 
conclusions and implications from 
data analyses 

7, Formulating statements of a theory 
that offers an explanation (cause- 
effect relationship) of the behavior 
under study 

8. Conceptualizing educational systems, 
their elements, and interrelations 
among these elements 

9* Specifying desired performance out- 
comes (objectives) of instruction 

10* Describing a product to be developed 

11* Composing effective oral and written 
forms of instructional communications 

12* Designing and managing field try- 
outs and tests 
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Section B Section C 



How Skills Were Acquired 


Need for Additional Training 
in Associated Skills 


Have Not 
Acqui red 
Skills 


Mostly 

Through 

Formal 

Education 

and 

Training 


Mostly 
Through 
Experience 
on the Job 


About 
Equally 
Through a 
Combination 
of Both 


Little 
or No 

Additional 

Need 


Moderate 

Need 


Great 
Need for 
Additional 
Training 






X 








X 


















































* 




































































































— 
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Section A 



R-p-p-E ACTIVITIES 

13. Defining and analyzing character- 
istics of target group (s ) for 
product dissemination 

14. Selecting the most effective dis- 
semination vehicles to convey 
information to target groups 

15. Implementing actual dissemination, 
including the direction of tech- 
nical production personnel 



16, Specifying nature of a product 
demonstration 

17. Identifying features of an adopt- 
ing organization or system which 
differ from those in which a 
product was developed and tested 

18. Devising and conducting long- 
range evaluation of an installed 
product package 

19, Identifying the nature of the 
standards or norms that decision- 
makers will apply in interpreting 
the relevant educational data that 
may be provided 



20, Explicating the problems that 
create discrepancies between 
actual and intended system out- 
comes and diagnosing the causes 
of these problems 

21, Helping educational system personnel 
to establish priorities for selected 
system objectives 

22, Identifying and rating alternative 
strategies for attaining the selected 
educational system objectives 



Involvement in Activities 



Little 
or No 
Involve- 
ment 



Moderate 

Involve- 

ment 



Heavy 
Involve - 
ment 



Have Not 
Acqui red 
Skills 



■'V, 
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Section B Sect ion C 





How Skil] 


Ls Were Acquire 


d 


Need for Additional Training 
in Associated Skills 




Have Not 
Acquired 
Skills 


1 Mostly 
Through 
Formal 
1 Education 
j and 

I Training 


Mostly 
Through 
Experience 
on the Job 


About 
Equally 
I Through a 

I Combination 
of Both 


Little 
or No 

Additional 

Need 


Moderate 

Need 


Great 
Need for 
Additional 
Training 
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Section A 







Involvement in Activities 


- 




R-D-D-E ACTIVITIES 


Little 
or No 
Involve- 
ment 


Moderate 

Involve- 

ment 


Heavy 
In vo 1 ve- 
me nt 


Have Not 
Acquired 
Skills 


23, 


Identifying and rating available 
educational program resources 
(human, material, and financial) 
and/or potential sources of support 










24 , 


Identifying alternative tactics to 
implement selected strategies and 
choose those that seem most likely 
to succeed 










25, 


Anticipating predicted barriers to 
programs and remaining alert to 
unanticipated problems that threaten 
their success 










26, 


Developing general criteria and 
designing data collection procedures 
for application in measuring the 
effectiveness and efficiency of 
existing innovative practices and 
products, i,e, , minimum standards 
and outcomes which indicate success- 
ful utilization of practices and 
products 




s 






27, 


If necessary, translating program 
objectives into behavioral terms 










28, 


Selecting (or developing) and using 
techniques of measurement to yield 
information relevant to standards to 
be used 










29, 


Collecting and organizing data 
preparatory to analysis 








j 


30, 


Deciding how to explain an outcome 
as a function of plans, procedures, 
and resources 










31. 


Specifying changes that need to be 
made in the context evaluation 
system due to decisions about 
program continuation 
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Section B _______ Section C 



How Skills Were Acquired 


Need for Additional Training 
in Associated Skills 


e Not 
uired 
ills 


Mostly 

Through 

Formal 

Education 

and 

Training 


Mostly 
Through 
Experience 
on the Job 


About 
Equally 
Through a 
Combination 
of Both 


Little 
or No 

Additional 

Need 


Moderate 

Need 


Great 
Need for 
Additional 
Training 








































— 


























































- — 









































“ 6 “ 



A number of educational areas are listed below. For each of the areas, please 
indicate the approximate amount ol' formal course work, graduate or undergraduate-, 
you have completed by placing a checkmark in the appropriate column. If you 
have had no course work in the area* place the checkmark in the "none" column* 



Educ ational Areas Number of C ou rs e s 







| None 


i 

i Few 


i 

I Several 

t 


i ! 

Many 1 






1 (0) 


; (1 or 2) 


: (3 to 3) 


! (6 or more) I 


1 * 


Statistics 


1 




1 


i - jvi 

i i 


2. 


Learning theory 







' 


i ; 

i 


3. 


Social Psychology 







i 


! 1 


A , 


Audio-Visual Education 






i 


i i 


5* 


Marketing 




; 


i 

1 


j , 


6, 


Sociology 


, 1 




__ 


[ i 


7. 


Re search design 




i 





i j 


8. 


Testing and measurement 




i 


i 

j 


i 


9. 


Systems theory 




! 


j 

j 


I 


10. 


Ad ve rt is ing 




i 


i 


| 


11. 


Educat. iona 1 administ fa t ion 






i 


i 

I 


12* 


Political science 




i 




i 


13, 


Philosophy of science 




! 


; 


I 


14. 


Data processing 




| 





i 


15* 


Theories of teaching 




! 




i 

i 


16. 


Cu rr i cu 1 urn de ve 1 opine n t 








i 

i 


17 . 


Communicat ion theory 




! __ j 




i 


18. 


Decision theory 




; I 

i — 




\ 


19. 


Information theory 


j 


I 

I 




! 


20. 


Journalism 


! 






1 


21. 


An t h ropo 1 og y 


i 






! 

j 


22 . 


Ot he r C s pe c i f v l ____ 






— 





Circ It* the three? areas from those listed that are most important for your current 
work, whether or not you have had course work in those areas 



3, Since you have been employed in this field how much of Llie following kinds of 

training relevant to uciucot iunal research, development, diffusion, or evaluation 
have you had? Indicate by placing a chock mark in the appropriate column after 
each kind of training 




Ty pe o f T ru i n i n g Amount of Training 





None 


Ve rv little 


Moderate 


Extensive 


Special supervised on the 
Job training or internship 










I n -s e r v i ce to u r s c j a 










O L ho r ( s p e c i f y ) 
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4, Below is a list of types of . employers* . 

In Section A , indicate the number of years you have boon employed by 
each of the types of employers. If none, write none in the space. 

In Section B, indicate the relevance of each type of previous employe 
ment to your present job by placing a checkmark in the appropriate column. 

If you have no previous experience put 
next item. 



Previous Employers 1 

j 

i 

i 

College or university j 

Educational R-D-D-E organizations 
Government 

Business and/or industry 
Other (specify 

5 # Indicate any skills you have in educational or R-D-D-E areas that you 
do not use in your present job, . 



a check mark here 



, and go to the 



Section A 



Number 
of years 



Section B 

Re levance 
to present job 



Low 



Mode r a t e 



High 



6, To what extent are you sat is lied with your present job? Place a checkmark 
below in the appropriate category. 

Completely Completely 

saticfinH SaHafleri Undecided Dissatisfied Dissatisfied 



3 

ERIC 



Completely 

Satisfied 



Satisfied 



Undecided 



Dissatisfied 



7 



To what extent are there advancement possi bi 1 1 t les in your present jobr* 
Place a checkmark below the appropriate category. 



Highly 

Probable 



High ly 

Probable Unknown Improbable Improbable 



8. Below is a list of types oi training or training materials. Indicate the 
value you place upon each type either to meet current job requirements or 
advancement plans by placing a checkmark in the appropriate column after 
each type. 



Types of additional 
t raining 

A, Programmed instruction materials 
for your own use 

B. Three to five day institutes 


Lift le 
o r no 
1 value 

i 

i 


Some 

value 


Groat 
va luo 








C, Longer institutes 

D, One or two week university 
short courses 

E, Correspondence courses 

F, Extension courses 

G, Other (specify) 






[ 






} 

i 












j 






i 

i 

! 



9 „ How important do you feel it is to receive college credit for any additional 
training you might obtain? Indicate by placing a checkmark below the appro- 
priate category. 

Extremely Completely 

Important Important Undecided Unimportant Unimportant 



If you checked "important" or "extremely important", please give your reasons 



PLEASE USE THE NEXT PAGE TO COIVMSNT ON THE QUESTIONNAIRE, 



o 
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Commc nts on L lie Qu e s 1 1 o n n a i re 



Since this questionnaire is being tested before preparation *n 
form for use throughout the country with educational R-D-D-E pe 
your comments on ils content unci format are us valuable as the 
you have made. Please comment as frankly as you desire. 



its final 
rsonne 1 , 
responses 



For each comment, p Lease reference 
make the appropriate changes (e.g, 

the meaning of activity # 

understand what I was supposed to 



the page and item number so 
, page $ item , could 
M ; or, page , item , 

do", and so on. 



that we can 
not understand 
"could not 
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Appendix C 

REVISED EMPLOYER AND EMPLOYEE QUESTIONNAIRES 







(Cover Letter from BESE or NCES for LEA Unit Directors) 



To The Unit Director: 

The study of which the enclosed questionnaire is a part is sponsored 
by the Research Training Branch of the National Center for Educational 
Research and Development, We urgently require data collected nationally 
and on a valid statistical basis in order to plan programs to meet the 
demand for trained personnel in Educational Research, Development, 
Diffusion and Evaluation, We ask, therefore, that you cooperate in 
filling out and returning the brief questionnaire promptly. 

In addition to the information obtained through the use of the enclosed 
questionnaire sent to project and unit directors and leaders, it is 
necessary to determine the perceptions of other project and unit personnel 
on related questions. For that purpose, a second brief questionnaire has 
been prepared. In order to select z sample of individuals to whom the 
second questionnaire will be sent we ask that you provide the survey 
contractor with a list of some of your unit personnel chosen as indicated 
on the cover page of the questionnaire. 

The study findings should be of substantial benefit to everyone concerned 
with Educational Research, Development, Diffusion and Evaluation in 
helping to insure an adequate supply of trained personnel. 

Your assistance is essential in providing valid and reliable information. 
It is very much appreciated. 




/ 
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(Employer Questionnaire Cover Letter for LEA Uni + Directors) 

SURVEY OF PERSONNEL IN EDUCATIONAL RESEARCH 
DEVELOPMENT, DIFFUSION, EVALUATION AND PLANNING ACTIVITIES 

To the Unit Director: 

The following questionnaire is concerned with employment demand and 
training needs for personnel in Educational Research, Development, 

Diffusion, Evaluation (R-D-D-E) and for those in Educational Planning. 

These activities are described on the following page. It is part of 
a study designed to assist in planning for the development and support 
of federally sponsored programs to respond to requirements for trained 
personnel (and training capabilities) in educational R-D-D-E. Because 
relevant, accessible training programs and training materials are 
important to both employers and employees in these fields, we earnestly 
request your cooperation in filling out the questionnaire. 

The survey is sponsored by the Research Training Branch of The National 
Center for Educational Research and Development and is the first survey of 
educational R-D-D-E personnel activities and training that has been 
conducted on the basis of a rigorous sampling design so that reasonable 
estimates of personnel in the various sectors of educational R-D-D-E 
can be made. 

Please respond in your capacity as director of your school district's 
R-D-D-E unit. 

In addition to filling out the questionnaire, we ask that you provide us 
with a listing of the names of project personnel who serve in professional 
or paraprofessi onal capacities, as those categories are defined in Item 2 
of the questionnaire, and on the enclosed sheet provided for the listing. 

The lists will form a basis for designing a sample of individuals to whom 
an additional questionnaire concerned with work activities and training 
will be sent. 

We realize the sensitivity of some of the information requested, and 
assure you that all data will be treated completely confidentially and 
the material will be analyzed and reported only by aggregates, e.g. , size 
of funding, type of R-D-D-E work, etc. The final page of the questionnaire 
contains a brief explanation of the reasons for asking the various questions 
and the use that will be made of the answers. In addition, we are enclosing 
a prepaid post card. If you would like to receive a brief summary of the 
report resulting from the survey, check the appropriate box on the card 
and return i t to us . 

Please return the questionnaire and the employee listing in the enclosed 
stamped, self-addressed envelope. 

Your prompt attention and cooperation will be very much appreciated. 
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Educational R-D-D-E Activities 

Educational Research includes activities which produce reliable 
knowledge about new facts, principles or theories. It employs the 
procedures of problem stating or hypothesis formulation, design, 
measurement and analysis, in order to permit the generalization of 
findings and replication, also, for purposes of verification. Educa 
tional research may be directed to highly diverse areas of investi- 
gation, such as the effects of teacher behavior upon student per- 
fonnance , stages of growth and development and their impact upon the 
learning process, racial-ethnic correlates of intelligence and achieve- 
ment, and the effects of individualized versus traditional instruction. 

Educational Development includes activities which create new 
educational methods , systems , materials or devices which have practical 
utility. It includes the design of new products, and field testing to 
determine their feasibility and the need for further modifications. 
Development also generates new products such as curriculum materials, 
teaching techniques, instructional media, ways of assigning pupils to 
school and architectural designs. 

Educational Diffusion involves procedures which create the necessary 
conditions for the adoption and utilization of new educational products 
or techniques. It includes activities such as the conduct of demonstra- 
tions, installation of new products on a trial basis, making adaptations 
to local school situations and making widespread dissemination of 
information about new educational products and their proven effectiveness. 

Educational Evaluati on includes activities that are necessary for 
determining the effectiveness of educational programs, products or pro- 
cedures. It may be done rigorously through deriving objective measures 
of effectiveness under carefully defined conditions and by comparing 
results against standards j or, evaluation may be conducted through more 
informal methods such as ratings. Many measures are used in evaluation 
that include student gains, teacher ratings, standardized aptitude 
scores, costs of educational programs and measures of ti me- to- comp I eti on 
of educational functions being studied. 

Educational Planning and Analysis^ includes activities directed toward 
the establishment of goals and objectives within operating constraints, 
and the development of strategies for attaining objectives after they 
have been ordered for priority. Outcomes may be evaluated by rigorous 
techniques such as economic, systems or psychometric analyses , however , 
informal observation techniques may be used also. Adjustment is made in 
objectives by educational planners through a process of feedback. Educa- 
tional planning involves projects that are highly varied such as assessing 
educational needs, reorgani zati on of curriculum for individualization, 
introduction of modular scheduling, goal-setting of achievement levels 
for disadvantaged students, and the utilization of para-professiona Is 
and teacher aides. 





QUESTIONNAIRE A (School District) 



Training and Personnel Requirements 
R-D-D-E (Supervisor Questionnaire) 



Name of School District 



Name of Respondent 



Name of Unit Supervised by Respondent ^ 



Position Title of Respondent 



Address 



Telephone 



Please describe briefly the kinds of projects in which your unit typically 
engaged and the major functions your unit performs in the school district. 
Description of projects* _ 



Maj or functions: 



O 
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Please enter the level of funding of the unit in which Research, Development, 
Diffusion and Evaluation work is done in the appropriate spaces. If data are 
not available, make the best estimate you can. 

Approximate level of unit funding from all sources for current 
fiscal year $ 

Approximate level of unit funding from all sources for next fiscal year 

$ 

Approximate percent of current fiscal year unit funds from: 

% Local School District 

% County Office of Education 

% State Office of Education (Specify) 

% U. S. Office of Education 

% Office of Economic Opportunity 
% Private Foundations 

% Other (Sped fy ) 



PLEASE ASSURE THAT ABOVE PERCENTAGES ADD TO 100% 





i 

t 

< 

f 
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1. In order to help us classify your project or unit work, which may involve 
several educational Research, Development, Diffusion, Evaluation, or 
related planning and management tasks, please indicate the degree to which 
each of the following activities is part of the work effort on your project 
or in your unit. 

Indicate the degree of project involvement in each activity by placing 
one of the following letters in the space provided before each item: 

Place an "L" in the space if a 1 arge part of the effort is 
devoted to the activity. 

Place an "M" in the space if a moderate part of the effort 
is devoted to the activity. 

Place an "S" in the space if a smal 1 part of the effort 
is devoted to the activity. 

Place an "N" in the space i f _no part of the effort 
is devoted to the activity. 



1 . 

2 . 



3 . 



4 . 

5 . 

6 . 

7 . 

8 . 

9 . 



10 . 



Level of 
Effort 

Conducting basic scientific inquiry related to educational 
" problems. 

Conducting applied research studies directly related to 
educational problems. 

Investigating and assessing educational needs and requirements. 

Gathering and providing information for program planning 
‘ and design. 

Developing new products or solutions for educational programs. 

Testing and evaluating innovative solutions and programs. 

Creating widespread awareness of tested solutions and programs. 

Demonstrating effectiveness of solutions and programs to 
target audiences. 

Training target audiences in the use of solutions and programs. 

Financial planning, and accounting for resources and 
expenditures. 



11 . 

12 . 




Preparing reports, documentation, etc. 

Training project/agency personnel to perform any R-D-D-E activity. 
Other ( soeci fv) - — _____ — — 
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2. Below is a list of definitions of personnel categories for individuals 
involved in R-D-D-E. 

• Professional 

Substantial responsibi 1 i ty for carrying out project 
or unit tasks independently 

• Paraprofess i onal 

Responsibility for carrying out project or unit tasks 
under moderate to heavy supervision, with little 
independence of action 

• Technical 

Trained for and carries out specific project activities 
such as computer programming, audio-visual aid preparation, 
or art work 

• Clerical 

Routine typing, f i 1 i ng, numeri cal and other clerical tasks 



The categories are given in the table below. Please indicate in the spaces 
provided for each category, the number of full-time individuals you employ 
on the project or in the unit, the number of part-time individuals and the 
number of full-time equivalents. 



Personnel Category F ull Time 

Professi onal 



Paraprofess i onal 



Technical 



Part Time 



Full-time 

Equivalents 




Cleri cal 
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3. Please list the names of project or unit personnel in professional 
and paraprofessional categories on this sheet. Use personnel 
category definitions in the previous item. 

The attached list of personnel has been supplied by the U. S. Office of 
Education. Please include these names on the list below if they are 
still working on the project, and add any new personnel not on the 
Office of Education list. 



After each name, indicate whether the individual works full time 
on the project or part itme. If full time, pi ace an "F" in the 
space. If part time, indicate the fraction that is worked, 
i.e,, etc. in the space. 



Professi onal 





i.m 

o 
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4. Indicate for each personnel category the number of currently unfilled 
positions, the number of losses in the last year and the number of 
personnel added in the last year. (If none, write "none" opposite 
the appropriate category.) Refer to category definitions in 
Question 2. 

Number of 
currently 
unf i 1 1 ed 

Personnel Categories positions 

Professional 

Paraprofessi onal 

Technical 

Clerical 

Indicate major reasons for current vacanci 



Indicate major reasons for losses, if any. 



Indicate major reasons for additions, if any. 



Number of 
losses in 
last year 






■if An \/ 



Number of 
additions in 
last year 
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5. How many employees do you , antici pate hiring in the next two years 
for each of the following levels? (If none, write "none" opposite 
the appropriate category.) Refer to category definitions given in 
Question 2, 

Personnel Categories Number to be Hi red 

Professional 

Paraprofess i onal 

Technical 

Clerical 

6. If your funding were to be increased by a quarter (25% more than current 

funding) in the next year: 

A. How many people would you need in addition to present staff 

and at what levels? (e.g., "3 professionals"). Use the 
personnel categories given in Question 2 . __ 

B. What kinds of skills would they represent (e.g., proposal 

writing, statistical analysis)_ — 

7. Listed below are several kinds of in-house employee training. 

Check those you have used during the past year . 

Used During 

In-Hou s e Employee Training Past Year 

A. Special supervised CUT or internship 

B. One to two-week short courses 

C. One to five-day seminars or institutes 

D. Longer courses . 

E. Other (specify)^ ___ — 
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How much value do you place on the following 
current employees? 


training approaches for 


Place a check mark in the appropriate "value 1 


' column 










Value 


of Approach 




Training Approaches 


Little or 
no value 


Moderate 
val ue 


Great 

value 


A. 

B. 


Three to five-day institutes or seminars 
Longer institutes 








1 


i 

1 




— j 


1 

l i 




r 


One to two-week short courses 
Longer courses 




! 

i 




D. 














E. 

F 


Interships in other agencies 

Correspondence courses 

Extension or other course arrangements 
with colleges or universities on a 
released time basis 

Extension or other course arrangements 
with colleges or universities on an 
employee's own time 








G. 








H. 








I. 


Other (specify) 









9, Have you done any recruiting in the last year? Yes No 

If you answered "yes", please respond to Question 10 through Question 14. 

If you answered "no", turn to page^ and answer Question 14. 

(To be answered only if you said "yes" to Question 9) ... 14 . 

10. Are there any ski 11s or sensi ti vl ties that have been particularly difficult 
to find in recruiting staff for your project or unit? Yes No 

If you answered "yes", please describe. 
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(To be answered only if you said "yes" to Question g) 

11. Have you had difficulty in recruiting personnel with qualifications in 
specific content areas such as early childhood education, minority 
education, remedial reading, vocational education or others? 

Yes No 



If you answered "yes", please specify areas. 



(To be answered only if you said "yes" to Question 9) 

12. Listed below are a number of recruiting procedures . First, place a checkmark 
in the left hand column by those you have used. Next, for each one that is 
checked, indicate how effective it has been in finding people with appropriate 
skills by placing a checkmark in the appropriate column. 



Effectiveness of Recruiting Pro ce dures 



Recruiting Procedures 


Have 

Used 


Mi ni mal ly 
Effective 


Moderately 
Ef fecti ve 


Very 

Ef fecti ve 


A, 


Journal or newspaper 
advert i sing 










B. 


Professional meeting 
employment services 


A 




l 




C. 


Referral by other 
employees 










D. 


Colleges and university 
employment services 










E. 


Informal survey of 
professional colleagues 










F, 


Review of unsolicited 
appl i cati ons 










G. 


Recruitment from within 










H, 


Other(speci fy ) 
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(To be answered only if you said "yes" to Question 9) 

13. Listed below are a number of selection techniques . First, place a 
checkmark in the left hand column by each technique you have used. 
Next, for each one that is checked, indicate how effective it has been 
for you in identifying personnel with needed skills by placing a 
checkmark in the appropriate column. 



Effectiveness of Selection Techniques 



Selection Have I 

Techniques Used J 


Mi nimal ly 
Effective 


Moderately 

Effective 


Very 

Effective 


A. Interviews 




B. Tests 








C. Application 
blanks 








D. References 








E. Work samples 








F. Other (specify) 








i 

















Please comment on any special problems in using the selection techniques. 



14. Please comment on any aspects of educational R-D-D-E employment or training 
that are of interest or concern to you. 
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Rationale for Questionnaire A Items 



Identifying information will be used for preparing tabular 
presentations and for making comparisons of personnel needs and 
training in various kinds of R-D-D-E activities. 

Responses to Question 1 will provide the basis for classifying 
projects or units as to their major focus as Research, Development, 
Diffusion, Evaluation or Planning activities. 

Responses to Questions 2 through 6 will provide the basis for 
analysis of current R-D-D-E personnel structures by category and for 
analysis of current and projected needs. 

Responses to Questions 7 and 8 will indicate kinds of training 
currently in use and estimates of the worth of various kinds of 
training in helping educational R-D-D-E employees to upgrade their 
ski 11s. 

Responses to Questions 9 through 13 will provide information 
on skills and knowledge that are in short supply currently, as indicated 
by recruiting difficulties, and therefore on areas in which training 
emphasis might be placed. Effective recruiting procedures and recruiting 
techniques will also be identified. 



452 



o 



(Cover Letter from NCERD or NCES for Project Directors ) 



To The Project Director: 

The study of which the enclosed questi onnai re is a part is sponsored 
by the Research Training Branch of the National Center for Educational 
Research and Development, We urgently require data collected nationally 
and on a valid statistical basis in order to plan programs to meet the 
demand for trained personnel in Educational Research, Developments 
Diffusion and Evaluation. We ask , therefore, that you cooperate in 
filling out and returning the brief questionnaire promtply. 

In addition to the information obtained through the use of the enclosed 
questionnaire sent to project and unit directors and leaders? it is 
necessary to determine the perceptions of other project and unit personnel 
on related questions. For that purpose? a second brief questionnaire has 
been prepared. In order to select a sample of individuals to whom the 
second questionnaire will be sent we ask that you provide the survey 
contractor with a list of some of your project personnel chosen as 
indicated on the cover page of the questionnaire. 

The study findings should be of substantial benefit to everyone concerned 
with Educational Research? Development, Diffusion and Evaluation in 
helping to insure an adequate supply of trained personnel. 

Your assistance is essential in providing valid and reliable information. 
It is very much appreciated. 
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(Employer Questionnaire Cover Letter for Project Directors) 



SURVEY OF PERSONNEL IN EDUCATIONAL RESEARCH, 
DEVELOPMENT, DIFFUSION, EVALUATION AND PLANNING ACTIVITIES 



To The Project Director: 

The following questionnaire is concerned with employment demand and 
training needs for personnel in Educational Research, Development, 

Diffusion, Evaluation (R-D-D-E), and for those in Educational Planning. 

These activities are described on the following page. It is part of a 
study designed to assist in planning for the development and support 
of federally sponsored programs to respond to requirements for trained 
personnel (and training capabilities) in educational R-D-D-E. Because 
relevant, accessible training programs and training materials are 
important to both employers and employees in these fields, we earnestly 
request your cooperation in filling out the questionnaire. 

The survey is sponsored by the Research Training Branch of The National 
Center for Educational Research and Development and is the first survey of 
educational R-D-D-E personnel activities and training that has been 
conducted on the basis of a rigorous sampling design so that reasonable 
estimates of personnel in the various sectors of educational R—D-D-E 
can be made. 

p] ease respond in your capacity as director or leader of a federally 
funded R-D-D-E project. Your responses to the items should have reference 
to the major such project on which you serve in a leadership capacity. 

In addition to filling out the questionnaire, we ask that you provide us 
with a listing of the names of project personnel who serve in professional 
or paraprofessi onal capacities, as those categories are defined in Item 2 
of the questionnaire, and on the enclosed sheet provided for the listing. 

The lists will form a basis for designing a sample of individuals to whom 
an additional questionnaire concerned with work activities and training 
will be sent. 

We realize the sensitivity of some of the information requested and assure 
you that all data will be treated completely confidentially and the material 
will be analyzed and reported only by aggregates, e.g., size of funding 
type of R-D-D-E work, etc. The final page of the questionnaire contains a 
brief explanation of the reasons for asking the various questions and the 
use that will be made of the answers. In addition, we are enclosed a pre- 
paid post card. If you would like to receive a brief sumnary of the report 
resulting from the survey, check the appropriate box on the card and return 
1 t to us , 

Please return the questionnaire and the employee listing in the enclosed 
stamped, self-addressed envelope. 

Your prompt attention and cooperation will be very much appreciated. 



Educati onal R-D-D-E Activit ies 

Educational Research includes activities which produce reliable 
knowledge about new facts, principles or theories. It employs the 
procedures of problem stating or hypothesis formulation, design, 
measurement and analysis, in order to permit the generalization of 
findings and replication, also, for purposes of verification. Educa- 
tional research may be directed to highly diverse areas of investi- 
gation, such as the effects of teacher behavior upon student per- 
formance, stages of growth and development and their impact upon the 
learning process, raci al -ethni c correlates of intelligence and achieve- 
ment, and the effects of individualized versus traditional instruction. 

Educational Development includes activities which create new __ 

educational methods, systems, materials or devices which have practical 
utility. It includes the design of new products, and field testing to 
determine their feasibility and the need for further modi fi cati ons. 
Development also generate c new products such as curriculum materials, 
teaching techniques, instructional media, ways of assigning pupils to 
school and architectural designs. 

Educational Diffusion involves procedures which create the necessary 
conditions for the adoption and utilization of new educational products 
or techniques. It includes activities such as the conduct of demonstra- 
tions, installation of new products on a trial basis, making adaptations 
to local school situations and making widespread dissemination of 
information about new educational products and their proven effectiveness. 

Educational Evalua tion includes activities that are necessary for 
determining the effectiveness of educational programs , products or pro- 
cedures, It may be done rigorously through deriving objective measures 
0 f effectiveness under carefully defined conditions and by comparing 
results against standards; or, evaluation may be conducted through more 
informal methods such as ratings. Many measures are used in evaluation 
that include student gains, teacher ratings, standardized aptitude 
scores, costs of educational programs and measures of ti me-to-compl eti on 
of educational functions being studied. 

Educational Planning and Analysis^ includes activities directed toward 
the establishment of goals and objectives within operating constraints, 
and the development of strategies for attaining objectives after they 
have been ordered for priority. Outcomes may be evaluated by rigorous 
techniques such as economic, systems or psychometric analyses ; however , 
informal observation techniques may be used also. Adjustment is made in 
objectives by educational planners through a process of feedback. Educa- 
tional planning involves projects that are highly varied such as assessing 
educational needs, reorganization of curriculum for individualization, 
introduction of modular scheduling, goal-setting of achievement levels 
for disadvantaged students, and the utilization of para- profess i ona I s 

and teacher aides. 
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QUESTIONNAIRE A (Project) 
Training and Personnel Requirements 
R-D-D-E (Project Director Questi onnai re) 



Project Ti tie 
Project Director 
Position Title _ 
Address 



Telephone 

Agency Receiving Contract or Grant 
Agency Director and Title 



Address 



Telephone 



Sponsoring/Funding Agency 
Agency Department 
Project Off i cer 

Primary Project Objective 



Starting Date of Project 
Ending Date of Project 
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Place a checkmark beside the type of organization in which the project resides: 



_Educational R&D Center 
.Educational Laboratory 

College, School of Education, 
Department or other 
university office 

Private nonprofit organization 

Industry or commercial 
organ! zati on 

Other (specify) 



Public School or School District 
_State Department of Education 
Professional Association 
Agency of Federal Government 
Specify department 



Approximate level of project funding from all sources for curre nt fiscal year 

$ ____ 

Approximate level of project funding from all sources for last fiscal year 

$ 

Anticipated level of project funding from all sources next fiscal year 

$ 

Approxi mu te percent of current fiscal year project funds from: 

% U.S, Office of Educat i on 

% Office of Economic Opportunity 

% National Science Foundation 

% Other federal agencies (specify) 

% State ( spec i fy ) 

% Private Foundations 



_£ Local School District 
% Industry 
% Other (specify) 



PL fc AS SURE THAT ABOVE PERCENTAGES ADD TO 100% 






- 3 - 



1. In order to help us classify your project or unit work, which may involve 
several educational Research, Development, Diffusion, Evaluation, or 
related planning and management tasks, please indicate the degree to which 
each of the following activities is part of the work effort on your project 
or in your unit. 

Indicate the degree of project involvement in each activity by placing 
one of the following letters in the space provided before each item: 



Place an T" in the space if 
devoted to the activity. 

Place an "M" in the space if 
is devoted to the activity. 

Place an "S" in the space if 
is devoted to the activity. 



a large part of the effort is 
a moderate part of the effort 
a small part of the effort 



Place an "N" in the space if no part of the effort 
is devoted to the activity. 



1 . 

2 . 



3 . 



4 . 

5 . 

6 . 

7 . 

8 . 

9 . 



10 . 



11 . 

12 . 




Level of 
Effort 

Conducting basic scientific inquiry related to educational 
problems. 

Conducting applied research studies directly related to 
educational problems. 

Investigating and assessing educational needs and requirements. 

Gathering and providing information for program planning 

~~ ’ and design. 

Developing new products or solutions for educational programs. 

Testing and evaluating innovative solutions and programs. 

Creating widespread awareness of tested solutions and programs. 

Demonstrating effectiveness of solutions and programs to 
target audiences. 

Training target audiences in the use of solutions and programs. 

Financial planning, and accounting for resources and 
~ expenditures. 

Preparing reports, documentation, etc. 

Training project/agency personnel to perform any R-D-D-E activity. 
Other (speci fy ) — 

*58 ’ ’ 
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2. Below is a list of definitions of personnel categories for individuals 
involved in R-D-D-E. 

• Professional 

Substantial responsibility for carrying out project 
or unit tasks independently 

• Paraprofessi onal 

Responsibility for carrying out project or unit tasks 
under moderate to heavy supervisions with little 
independence of action 

• Technical 

Trained for and carries out specific project activities 
such as computer programming, audio-visual aid preparation, 
or art work 

• Clerical 

Routine typing, fi ling, numerical and other clerical tasks 



The categories are given in the table below. Please indicate in the spaces 
provided for each category, the number of full-time individuals you employ 
on the project or in the unit, the number of part-time individuals and the 
number of full-time equivalents. 



Personnel Category Full Time 



Part Time 



Full-time 
Equi val ents 



Profess i onal 



Paraprofessi onal 



Techni cal 



Cleri cal 
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3. Please list the names of project or unit personnel in professional 
and paraprofess i onal categories on this sheet. Use personnel 
category definitions in the previous item. 

The attached list of personnel has been supplied by the U. S. Office of 
Education. Please include these names on the list below if they are 
still working on the project, and add any new personnel not on the 
Office of Education list. 



After each name, indicate whether the individual works full time 
on the project or part itme. If full time, place an "F" in the 
space. If part time, indicate the fraction that is worked, 
i.e., 'a, etc. in the space. 



Professi onal 



Name 


Fracti on 
Of Time 
Worked 







































Paraprofessl onal 



Name 


Fracti on 
Of Time 
Worked 
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4, 



Indicate for each personnel category the number of currently unfilled 
positions, the number of losses in the last year and the number of 
personnel added in the last year, (If none, write "none" opposite 
the appropriate category.) Refer to category definitions in 
Question 2. 



Personnel Categories 



Number of 
curren tly 
unf i 1 led 
pos i ti ons 



Number of 
| losses in 
i 1 ast year 



Number of 
additions in 
1 ast year 



Professional j 

1 

Paraprofess i onal 

Technical 

Clerical 

Indicate major reasons for current vacancies, if any. 



Indicate major reasons for losses, if any. 



Indicate major reasons for additions, if any. 



161 
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5. How many employees do you anticipate hiring in the next two years 
for each of the following levels? (If none, write “none" opposite 
the appropriate category.) Refer to category definitions given in 
Question 2. 



Personnel Categories Number to be Hired 

Professional 

Paraprofessional 



Techni cal 



Clerical 

6. If your funding were to be increased by a quarter (25% more than current 
funding) in the next year: 

A. How many people would you need in addition to present staff 
and at what levels? (e.g., "3 professionals"). Use the 
personnel categories given in Question 2. 



B. What kinds of skills would they represent (e.g., proposal 
writing, statistical analysis) 



7. 



Listed below are several kinds of in-house employee training. 
Check those you have used during the 



Used During 

In-House Employee Training Past Year 

A. Special supervised OJT or internship __ 

B. One to two-week short courses _____ 

C. One to five-day seminars or institutes 

D. Longer courses 

E. Other (specify) 



?.€3 




8. How much value do you place on the following training approaches for 
current employees? 

Place a check mark in the appropriate "value" column 



Training Approaches 

A, Three to five-day institutes or seminars 

B, Longer institutes 

C, One to two-week short courses 

D, Longer courses 

E, Interships in other agencies 

F, Correspondence courses 

G, Extension or other course arrangements 
with colleges or universities on a 
released time basis 

H, Extension or other course arrangements 
with colleges or universities on an 
employee's own time 

I, Other (specify) 



Value of Approach 



Little or 
no value 


Moderate 

value 


Great 

value 














i 

* 

i 

1 


! 

! 

i 







































9, Have you done any recruiting in the last year? Yes No 

If you answered "yes", please respond to Question 10 through Question 14. 
If you answered "no", turn to page and answer Question 14. 



(To be answered only if you said "yes" to Question 9) _ j| 

10. Are there any skills or sens i ti vi ti es that have been particularly difficult ) 
to find in recruiting staff for your project or unit? Yes No 

■ 

If you answered "yes", please describe. yj 

5 





(To be answered only if you said "yes" to Question 9 ) 

11 . Have you had difficulty in recruiting personnel with qualifications in 
specific conte nt are as such as early childhood education, minority 
education, remedial reading, vocational education or others? 

Yes No 



If you answered "yes", please specify areas. 



(To be answered only if you said "yes" to Question 9) 

12. Listed below are a number of recruiting procedures . First, place a checkmark 
in the left hand column by those you have used. Next, for each one that is 
checked, indicate how effective it has been in finding people with appropriate 
skills by placing a checkmark in the appropriate column. 



Effectiveness of Recruiting Procedures 



Recruiting Procedures 


Have 

Used 


Minimal ly 
Effect! ve 


Moderately 
Effecti ve 


Very 

Effecti ve 


A. 


Journal or newspaper 
adverti si ng 










B. 


Professional meeting 
emp 1 oyme n’t services 










C. 


Referral by other 
employees 








u . 


D. 


Colleges and university 
employment services 










E. 


Informal survey of 
professional colleagues 








_ 


F. 


Review of unsolicited 
appl i cati ons 










G. 


Recruitment from within 


-■ 










H. 


Other(speci fy ) 




! 

i 
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(To be answered only if you said "yes" to Question 9) 

13. Listed below are a number of selection techniques . First, place a 
checkmark in the left hand column by each technique you have used. 
Next, for each one that is checked, indicate how effective it has been 
for you in identifying personnel with needed skills by placing a 
checkmark in the appropriate column. 



Effectiveness of Selection Techniques 



Selection Have 

Techniques Used 


Minimal ly i Moderately 
Effective Effe ctiv e 


Very 

Effect! ve 


A. Interviews 




i 


B. Tests 








C, Application 
blanks 








D. References 








E. Work samples 

F. Other (specify) ! 































Please comment on any special problems in using the selection techniques. 



14. Please comment on any aspects of educational R-D-D-E employment or training 
that are of interest or concern to you. 




Rationale for Questionnaire A Items 



Identifying information will be used for preparing tabular 
presentations and for making comparisons of personnel needs and 
training in various kinds of R-D-D-E activities. 

Responses to Question 1 will provide the basis for classifying 
projects or units as to their major focus as Research, Development, 
Diffusion, Evaluation or Planniag activities. 

Responses to Questions 2 through 6 will provide the basis for 
analysis of current R-D-D-E personnel structures by category and for 
analysis of current and projected needs. 

Responses to Questions 7 and 8 will indicate kinds of training 
currently in use and estimates of the worth of various kinds of 
training in helping educational R-D-D-E employees to upgrade their 
skills. 

Responses to Questions 9 through 13 will provide i n fonriati on 
on skills and knowledge that are in short supply currently, as indicated 
by recruiting difficulties, and therefore on areas in which training 
emphasis might be placed. Effective recruiting procedures and recruiting 
techniques will also be identified. 
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(Employee Questionnaire Cover Letter) 



To The Respondent: 

The attached questionnaire relates to one part of a survey of 
employment demand and training for personnel in Educational 
Research, Development, Diffusion and Evaluation (R-D-D-E). 

You have been identified by your supervisor as one who is engaged 
more of these activities. We ask your cooperation in 
filling, out the questionnaire. 

You may have filled out questionnaires that appear to be similar in 
the past, but this is the first survey of educational R-D-D-E that 
has been conducted on the basis of a rigorous sampling design so 
that reasonable estimates of personnel in the various sectors of 
educational R-D-D-E can be made. 

We realize the sensitivity of some of the information requested and 
assure you that all responses are completely confidential and will 
be seen only by study personnel. Material will be analyzed only by 
aggregates, and there will be no reporting of individual responses. 
Certain questions are being asked in order to compare equality of 
employment, salary levels, age groupings, etc. with those in other 
occupations. The final page of the questionnaire contains a brief 
explanation of the reasons for asking the various questions and the 
use that will be made of the answers. 

When you have completed the questionnaire, please return it directly 
to us in the attached, stamped, self-addressed envelope. 

Your prompt attention and cooperation will be greatly appreciated. 



Questionnaire B 



Project Code No. 



Name (optional) 



! Sex 


Check the appropriate 


1 

Actual 


i 

Annual Salary ! 


i Hale 


age category 




i Under S 3,000 


j 

$18,000 - 520,999 j 




Under 25 


45 - 49 


i 




Jemal e - 


__25 - 29 




! S 3,000 - $ 5,999 


$21 ,000 - $23,999 j 


■ — : 


50 - 54 


i 


i 


• Ethni c 






' S 6,000 - S 8,999 


$24,000 - $26 ,999 i 


i I denti f i cati on j 

1 


_30 - 34 


55 - 59 


$ 9,000 - $ 11 ,999 


$27,000 - $29,999 


: Caucasian i 


35 - 39 


60 - 64 


| 




; 1 

Black 

i ' i 

■' i 


__40 - 44 




i $12,000 - S 14,999 


$30,000 or more 


_ Over 64 


! $15,000 - S 17,999 


f 

i 


: Spanish 

i surname 

j Oriental 

i 

Other 

(sped fy ) 






’ 1 

i If less than full time, indicate ! 

, approximate fraction of full time that i 

you work, e.g,, i 4i ‘s, etc. i 

i 

; 

j 

, i 


„ .. . 








... 



Please indicate the complete title of the project or activity on which you are 
currently working. 



Write your job title or position 

How long have you worked in your present job? 

Number of years Number of months if less than one year 

How many people do you supervise in this capacity? 

I f none , wri te "0" . 

Briefly describe what you do on this job. 
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Check the highest level of formal education you have obtained. 

High school with no college level course work 

High school and some college courses, but do not have a 
degree or certificate yet. Number of years completed 

Two years of college completed with a degree or certificate 

_Bachelors degree 

__Masters degree 

Masters degree plus work toward doctorate 
Doctorate or post-doctoral degree 

Other professional degree, specify type 

If you have obtained a bachelors or a higher degree, please write in your 
major field, e.g., education, psychology, etc. _ 



1. Have you been employed previous to your present job? Yes No 

If you answered "yes", complete the remainder of this question. 

If your answer was "no", go on to the next question. 

In Section A, indicate the number of years you have been employed by each type of 
employer" Tf none, write "none" in the space. 

In Section B , indicate the relevance of each type of previous employment to your 
present job by placing a checkmark in the appropriate column. 



Section A 
Number 


Section B 

Relevance to Present Job 


Previous Employers of years 


Low 


| Moderate 


High 


College or university 


i 





_ 


Educational R-D-D-E organizations 


i 

: i 


i 




Government 


. j 

! ! 




j - 

i 


! 

Business and/or industry 


j 




n 


School district 

Other (specify) 


; t 

< ! 

j 


i 
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2. A number of educational areas are listed below. For each of the areas , please 

indicate the approximate amount of formal course work, graduate or undergraduate , 
you have completed by placing a checkmark in the appropriate column. If you 
have had no course work in the area, place the checkmark in the "none" column. 



Educ ati o nal Areas 



Number of Courses 



1. Statistics 

2. Learning theory 

3. Social Psychology 

4. Audio-Visual Education 

5. Marketing 

6. Sociology 

7. Research design 

8. Testing and measurement 

9. Systems theory 

10. Advertising 

11. Educational administration 

12. Political science 

13. Philosophy of science 

14. Data processing 

15. Theories of teaching 

16. Curriculum development 

17. Communication theory 

18. Decision theory 

19. Information theory 

20. Journalism 

21. Anthropology 

22. Other (specify) 



None 

101 









i 

! 



I 

I 



! 

i 



! 





Circle the three areas from those listed above that are most important for your 
current work, whether or not you have had course work in those areas. 
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3, On the following panes is a list ov activities that may be performed by those 
working in educational Research, Development, Diffusion, Evaluation, ami/or 
Planning. Please indicate the degree to which vou are currently involved in 
each activity by entering a number value between 0 and 7 in the space provided 
to the left of each item. The numerical scale that you are to use i s defined 
as follows: 



0 - Definitely not a part, of my work activity. 

~ l - Only a minor' part of my work 

“ o 

& 

" 3 

4 - A s ubstan ti al part of my work 

5 

_ 6 

7 - A most sign ificant part of my work 

Those numbers that are not defined may bo used in accordance with your best, 
judgment as to their positions on the scale between the anchoring definitions. 

In the space following each item, please indicate the degree of .your 
interest in obtaining additional training in the activities specified by 
using the following symbols; 



Place a "G" in the space if you have Great 
Interest in additional training. 

Place an "S" if you have only a Small 
Interest in additional training. 



Place an "N" if you have No Interest in 
additional training. 

Your Current Involvement 
(Enter one number 
from 0 - 7 scale) 



Your Interest In 
Add! tional Training 
(Enter "U" ,"S" , or "N" ) 



1. __ Synthesizing literature relevant to a project 

2, Choosing variables for research or experimental treatment. 

3 . ____ Developing measuring instruments. 

4, Organizing data for analysis, 

5 , Selecting statistical techniques that are appropriate 
for analysis or conducting tests of data. 

6. _ Using aids in data analysis, such as computer processing, 

7 ^ Drawi ng conclusions from data analyses and reporting findings 

Q t Specifying performance objectives of instruction, 

g Describing a product to be developed. 





-5- 



Your Current Involvement 
(Enter one number 
from 0-7 scale) 



Your Interest in 
Additional Trainin 
(Enter "G" , "S" , or "N 



10, Designing and managing field tests 

11, Revising a product based upon field evaluation, 

12, Determining characteristi es of target groups for 
” product dissemination. 



13. Selecting the best way to get information to target groups. 

14. Composing information for widespread dissemination. 

15. __ Implementing actual dissemination. 

16. Devising long term evaluation of an installed product, 

17. Identifying desired outcomes of an educational system 

18. Establishing priorities among school system objectives. 

19. Evaluating strategies for attaining school system 

objectives. 

20. Determining educational program resources (human, material, 
financial), 

21. Writing proposals for either R, D, D, or E projects, 

22. ___ Moni toring educational programs to determine deviations 
~~ from design plans. 

23. Developing criteria and data collection procedures for 

measuring effectiveness of innovative practices and 
products . 

24. Translating program objectives Into behavioral terms. 

25. Using techniques of measurement to derive data for 
establishment of standards. 

26. Other (specify) 

27. Other (specify) 
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4, Since you have been employed in this field, how much of the following kinds of 
training relevant to educational Research, Development, Diffusion, or Evaluation 
have you had? Indicate by placing a checkmark in the appropriate column after 
each kind of training. 



Type of Training 
Special supervised on-the- 




Amount 


of Training 




None 


Very little 


i Moderate 


Extensi ve 


job training or internship 


— 






— 


In-service courses 
Other (specify) 






! 

1 


: 

| 



5. Several approaches to training are listed below. Indicate the value you place 
upon each approach either to meet current job requirements or plans you might 
have for personnel advancement. Place a checkmark in the appropriate column 
after each approach. 



Training Approach 

A. Programmed instruction 
materials for your own use 

B. Three to five-day institutes 

C. Longer institutes 

D. One or two-week university 
short courses 

E. Correspondence courses 

F. Extension courses 

G. Other (specify) 

Comments : 



V alue of Approach 



Little or 
no value 


Some Value 


Great Valui 




I 


— 


i 

i 

1 

j 


| 

1 

j _ ^ 




— 


— 







1.73 
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6. How important do you feel it is to receive college credit for any additional 
training you might obtain? Indicate by placing a checkmark below the 
appropriate category. 



Extremely 

Important Important 



Undecided 



Unimportant 



Extremely 

Unimportant 



If you checked "important" or "extremely important", please give your reasons. 



7. To what extent are you satisfied wi th your present job? Place a checkmark below 
In the appropriate category. 

Extremely Extremely 

Satisfied Satisfied Undecided Dissatisfied Dissatisfied 



Please comnent on reasons for satisfaction or dissatisfaction with your job. 



8. To what extent is advancement probable in your present job? 

Place a checkmark below the appropriate category. 

Highly Highly 

Probable Probable Unknown Improbable Improbable 



Please comment on reasons for your estimate of probability of advancement 





-U 

,rf 




8 



9. Please enter any additional comments below that you would like to make 
on R-D-D-E employment and training. 
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Rationale for Questionnaire B Items 



Information as to age, sex, ethnic identification, education and 
salary will make possible comparisons with other occupations. 

Job titles and descriptions will permit classification into 
Research, Development, Diffusion, Evaluation and Planning categories. 

Responses to Question 1 will indicate the sources from which 
employees came in R-D-D-E work and possible relationships between 
R-D-D-E and other types of employment. 

Responses to Question 2 will provide specific information as 
to educational backgrounds and help to identify training areas for 
future R-D-D-E employees. 

Responses to Question 3 will indicate the relative involvement 
of R-D-D-E employees in various kinds of activities and will suggest 
areas of investigation for meeting needs for training. 

Responses to Question 4 through 6 will indicate the kinds of 
training now in process for R-D-D-E personnel, the kinds they feel to 
be valuable and the importance of college credit for additional training. 
These responses will have implications for the development of training 
policy and programs. 

Responses to Questions 7 and 8 will indicate job satisfaction 
and advancement possibilities and will have implications for attracting 
and recruiting personnel into R-D-D-E work, and providing greater 
value in these activities for current employees. 



Appendix D 

COST OF PREPARING AND MAILING QUESTIONNAIRE FOR FIELD TEST 
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COST OF PREPARING AND MAILING 
QUESTIONNAIRES FOR FIELD TEST 



Cost of preparation 

Coordination, typing and proofreading .$ 3.50 per page 

Printing from Camera Ready Copy 

(including collating, folding and binding) 2.70 per page 

Fold out master (11" x 17" 17.40 per page 

Mailing envelopes (per 100) , 2.00 

Return envelopes (per 100) 4.80 



Postage 



Employer plus 4 employee questionnaires 

(including 5 return envelopes and cover material) 1.20 

Employer questionnaire 

return envelope and cover material 40 



Employer questionnaire 

return envelope and cover material 40 



Single return 40 

Number printed: Questionnaire A. 125, Questionnaire B. 300 



Number of pages printed (32 @ $6.50 per page) 198.00 



Cost of foldouts (Photographic negative, 
plate and printing) 129.00 

Number packages sent (71) 85.00 



Number singles sent (38).. 
Number returned (58) 



m m m 



15.00 



. 23.00 



Approximate total cost 



$456.80 



Period includes: from date mailed 11/19, through 12/28/71, 

first returns received 11/23/71. 




